Imagen de Portada

Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Moghe, Nikita, Fazla, Arnisa, Amrhein, Chantal, Kocmi, Tom, Steedman, Mark, Birch, Alexandra, Sennrich, Rico, Guillou, Liane
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

AI-Assisted Human Evaluation of Machine Translation
por: Zouhar, Vilém, et al.
Publicado: (2024)

Machine Translation Models are Zero-Shot Detectors of Translation Direction
por: Wastl, Michelle, et al.
Publicado: (2024)

Evaluating Automatic Metrics with Incremental Machine Translation Systems
por: Wu, Guojun, et al.
Publicado: (2024)

Pearmut: Human Evaluation of Translation Made Trivial
por: Zouhar, Vilém, et al.
Publicado: (2026)

Déjà Vu: Multilingual LLM Evaluation through the Lens of Machine Translation Evaluation
por: Kreutzer, Julia, et al.
Publicado: (2025)

SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window
por: Raunak, Vikas, et al.
Publicado: (2023)

Estimating Machine Translation Difficulty
por: Proietti, Lorenzo, et al.
Publicado: (2025)

Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding
por: Sennrich, Rico, et al.
Publicado: (2023)

Investigating Multi-Pivot Ensembling with Massively Multilingual Machine Translation Models
por: Mohammadshahi, Alireza, et al.
Publicado: (2023)

Robustness of Misinformation Classification Systems to Adversarial Examples Through BeamAttack
por: Fazla, Arnisa, et al.
Publicado: (2025)

An Analysis of BPE Vocabulary Trimming in Neural Machine Translation
por: Cognetta, Marco, et al.
Publicado: (2024)

Source-primed Multi-turn Conversation Helps Large Language Models Translate Documents
por: Hu, Hanxu, et al.
Publicado: (2025)

Can LLMs Detect Intrinsic Hallucinations in Paraphrasing and Machine Translation?
por: Gogoulou, Evangelia, et al.
Publicado: (2025)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
por: Kocmi, Tom, et al.
Publicado: (2024)

Liaozhai through the Looking-Glass: On Paratextual Explicitation of Culture-Bound Terms in Machine Translation
por: Shen, Sherrie, et al.
Publicado: (2025)

Unlocking Reasoning Capability on Machine Translation in Large Language Models
por: Rajaee, Sara, et al.
Publicado: (2026)

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models
por: Lu, Qingyu, et al.
Publicado: (2023)

EuroGEST: Investigating gender stereotypes in multilingual language models
por: Rowe, Jacqueline, et al.
Publicado: (2025)

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies
por: Kocmi, Tom, et al.
Publicado: (2024)

Setting up the Data Printer with Improved English to Ukrainian Machine Translation
por: Paniv, Yurii, et al.
Publicado: (2024)

Evaluating the Meta- and Object-Level Reasoning of Large Language Models for Question Answering
por: Ferguson, Nick, et al.
Publicado: (2025)

Linear-time Minimum Bayes Risk Decoding with Reference Aggregation
por: Vamvas, Jannis, et al.
Publicado: (2024)

Measuring the Effect of Disfluency in Multilingual Knowledge Probing Benchmarks
por: Semenov, Kirill, et al.
Publicado: (2025)

Span-Level Machine Translation Meta-Evaluation
por: Perrella, Stefano, et al.
Publicado: (2026)

GAMBIT+: A Challenge Set for Evaluating Gender Bias in Machine Translation Quality Estimation Metrics
por: Filandrianos, Giorgos, et al.
Publicado: (2025)

Translation Asymmetry in LLMs as a Data Augmentation Factor: A Case Study for 6 Romansh Language Varieties
por: Vamvas, Jannis, et al.
Publicado: (2026)

Chapter Combinatory Categorial Grammar
por: Steedman, Mark
Publicado: (2022)

Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!
por: Perrella, Stefano, et al.
Publicado: (2024)

Question Translation Training for Better Multilingual Reasoning
por: Zhu, Wenhao, et al.
Publicado: (2024)

When Does Monolingual Data Help Multilingual Translation: The Role of Domain and Model Scale
por: Baziotis, Christos, et al.
Publicado: (2023)

Compact Speech Translation Models via Discrete Speech Units Pretraining
por: Lam, Tsz Kin, et al.
Publicado: (2024)

Examining Multilingual Embedding Models Cross-Lingually Through LLM-Generated Adversarial Examples
por: Michail, Andrianos, et al.
Publicado: (2025)

SwissGov-RSD: A Human-annotated, Cross-lingual Benchmark for Token-level Recognition of Semantic Differences Between Related Documents
por: Wastl, Michelle, et al.
Publicado: (2025)

Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?
por: Kew, Tannon, et al.
Publicado: (2023)

SwissBERT: The Multilingual Language Model for Switzerland
por: Vamvas, Jannis, et al.
Publicado: (2023)

Modular Adaptation of Multilingual Encoders to Written Swiss German Dialect
por: Vamvas, Jannis, et al.
Publicado: (2024)

Concept-Reversed Winograd Schema Challenge: Evaluating and Improving Robust Reasoning in Large Language Models via Abstraction
por: Han, Kaiqiao, et al.
Publicado: (2024)

Preliminary Ranking of WMT25 General Machine Translation Systems
por: Kocmi, Tom, et al.
Publicado: (2025)

Modelling Child Learning and Parsing of Long-range Syntactic Dependencies
por: Mahon, Louis, et al.
Publicado: (2025)

Prosody in Cascade and Direct Speech-to-Text Translation: a case study on Korean Wh-Phrases
por: Zhou, Giulio, et al.
Publicado: (2024)