Copertina

Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Thellmann, Klaudia-Doris, Stadler, Bernhard, Färber, Michael, Lehmann, Jens
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Diagnosing Translated Benchmarks: An Automated Quality Assurance Study of the EU20 Benchmark Suite
di: Thellmann, Klaudia, et al.
Pubblicazione: (2026)

Investigating Multilingual Instruction-Tuning: Do Polyglot Models Demand for Multilingual Instructions?
di: Weber, Alexander Arno, et al.
Pubblicazione: (2024)

Towards Multilingual LLM Evaluation for European Languages
di: Thellmann, Klaudia, et al.
Pubblicazione: (2024)

xTower: A Multilingual LLM for Explaining and Correcting Translation Errors
di: Treviso, Marcos, et al.
Pubblicazione: (2024)

Found in Translation: Measuring Multilingual LLM Consistency as Simple as Translate then Evaluate
di: Gupta, Ashim, et al.
Pubblicazione: (2025)

Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results
di: Peter, Jan-Thorsten, et al.
Pubblicazione: (2025)

Déjà Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation
di: Kreutzer, Julia, et al.
Pubblicazione: (2025)

Google Translate Error Analysis for Mental Healthcare Information: Evaluating Accuracy, Comprehensibility, and Implications for Multilingual Healthcare Communication
di: Delfani, Jaleh, et al.
Pubblicazione: (2024)

Evaluating Robustness of Large Language Models Against Multilingual Typographical Errors
di: Zhao, Raoyuan, et al.
Pubblicazione: (2025)

Mufu: Multilingual Fused Learning for Low-Resource Translation with LLM
di: Lim, Zheng Wei, et al.
Pubblicazione: (2024)

"Be My Cheese?": Assessing Cultural Nuance in Multilingual LLM Translations
di: Van Doren, Madison, et al.
Pubblicazione: (2025)

The Impact of Vocabulary Overlaps on Knowledge Transfer in Multilingual Machine Translation
di: Itkonen, Oona, et al.
Pubblicazione: (2026)

Lost in Translation? Translation Errors and Challenges for Fair Assessment of Text-to-Image Models on Multilingual Concepts
di: Saxon, Michael, et al.
Pubblicazione: (2024)

Translation as a Scalable Proxy for Multilingual Evaluation
di: Issaka, Sheriff, et al.
Pubblicazione: (2026)

Multilingual LLM Prompting Strategies for Medical English-Vietnamese Machine Translation
di: Vo, Nhu, et al.
Pubblicazione: (2025)

Decomposed Prompting: Probing Multilingual Linguistic Structure Knowledge in Large Language Models
di: Nie, Ercong, et al.
Pubblicazione: (2024)

Tracing Relational Knowledge Recall in Large Language Models
di: Popovič, Nicholas, et al.
Pubblicazione: (2026)

Extractive Fact Decomposition for Interpretable Natural Language Inference in one Forward Pass
di: Popovič, Nicholas, et al.
Pubblicazione: (2025)

Embedded Named Entity Recognition using Probing Classifiers
di: Popovič, Nicholas, et al.
Pubblicazione: (2024)

GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism
di: Yuan, Shuzhou, et al.
Pubblicazione: (2024)

Copy First, Translate Later: Interpreting Translation Dynamics in Multilingual Pretraining
di: Körner, Felicia, et al.
Pubblicazione: (2026)

Test Set Quality in Multilingual LLM Evaluation
di: Kranti, Chalamalasetti, et al.
Pubblicazione: (2025)

Asymmetric Conflict and Synergy in Post-training for LLM-based Multilingual Machine Translation
di: Zheng, Tong, et al.
Pubblicazione: (2025)

Is Multilingual LLM Watermarking Truly Multilingual? Scaling Robustness to 100+ Languages via Back-Translation
di: Mohamed, Asim, et al.
Pubblicazione: (2025)

"Is Hate Lost in Translation?": Evaluation of Multilingual LGBTQIA+ Hate Speech Detection
di: Chan, Fai Leui, et al.
Pubblicazione: (2024)

Multilingual KokoroChat: A Multi-LLM Ensemble Translation Method for Creating a Multilingual Counseling Dialogue Dataset
di: Suzuki, Ryoma, et al.
Pubblicazione: (2026)

Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators
di: Chang, Jiayi, et al.
Pubblicazione: (2025)

MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators
di: Lu, Qingyu, et al.
Pubblicazione: (2024)

Towards Reproducible LLM Evaluation: Quantifying Uncertainty in LLM Benchmark Scores
di: Blackwell, Robert E., et al.
Pubblicazione: (2024)

Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking
di: Chung, Yi-Ling, et al.
Pubblicazione: (2025)

A formal specification of the jq language
di: Färber, Michael
Pubblicazione: (2024)

Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
di: Wang, Xintong, et al.
Pubblicazione: (2025)

On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations?
di: Choenni, Rochelle, et al.
Pubblicazione: (2024)

Assessing the Impact of Typological Features on Multilingual Machine Translation in the Age of Large Language Models
di: Hirak, Vitalii, et al.
Pubblicazione: (2026)

Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMs
di: Mondshine, Itai, et al.
Pubblicazione: (2025)

PMMT: Preference Alignment in Multilingual Machine Translation via LLM Distillation
di: Sun, Shuqiao, et al.
Pubblicazione: (2024)

Science Across Languages: Assessing LLM Multilingual Translation of Scientific Papers
di: Kleidermacher, Hannah Calzi, et al.
Pubblicazione: (2025)

Quantifying Language Disparities in Multilingual Large Language Models
di: Hu, Songbo, et al.
Pubblicazione: (2025)

Conditions for Catastrophic Forgetting in Multilingual Translation
di: Liu, Danni, et al.
Pubblicazione: (2025)

Backdoor Attack on Multilingual Machine Translation
di: Wang, Jun, et al.
Pubblicazione: (2024)