Get Started
Research questionHow should machine translation research balance benchmark accuracy with stakeholders’ trust and quality needs?Benchmark accuracy does not capture all the ways people judge machine translation. Different communities may therefore disagree about whether a system is useful, reliable, or trustworthy.
AI
Evaluation & Benchmarks
Natural Language Processing
Latest papersRecent research connected to this question, newest first.Beyond Accuracy: Community Perspectives on Machine TranslationThe evidence comes from an analysis of 79,286 social-media posts and comments from AI developers, professional translators, language learners, and language service providers on Reddit, Facebook, Bluesky, and Mastodon from 2019 to 2025. It documents disagreements concerning translation quality, efficiency, reliability, trust, costs, and broader social issues, but does not establish how to resolve them.research paper · Sep 3, 2026
Related questions
How can we evaluate machine translation reliably and actionably as standard benchmarks saturate?How can context-aware translation exploit useful document context without harming sentences when context is irrelevant?How can we audit NL-to-FOL benchmarks so annotation errors do not distort model evaluation?How can reward models distinguish fine-grained translation quality across candidate groups during GRPO post-training?
Home
Topics
Search
Library