Copertina

Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Zhongtao, Riley, Parker, Deutsch, Daniel, Lui, Alison, Niu, Mengmeng, Shah, Apu, Freitag, Markus
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Enhancing Human Evaluation in Machine Translation with Comparative Judgment
di: Song, Yixiao, et al.
Pubblicazione: (2025)

MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation
di: Riley, Parker, et al.
Pubblicazione: (2025)

Finding Replicable Human Evaluations via Stable Ranking Probability
di: Riley, Parker, et al.
Pubblicazione: (2024)

Generating Difficult-to-Translate Texts
di: Zouhar, Vilém, et al.
Pubblicazione: (2025)

On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluation
di: Briakou, Eleftheria, et al.
Pubblicazione: (2024)

Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation
di: Kocyigit, Muhammed Yusuf, et al.
Pubblicazione: (2025)

From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set
di: Finkelstein, Mara, et al.
Pubblicazione: (2024)

Mitigating Metric Bias in Minimum Bayes Risk Decoding
di: Kovacs, Geza, et al.
Pubblicazione: (2024)

Penalizing Length: Uncovering Systematic Bias in Quality Estimation Metrics
di: Zhang, Yilin, et al.
Pubblicazione: (2025)

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task
di: Juraska, Juraj, et al.
Pubblicazione: (2024)

When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation
di: Xu, Wenda, et al.
Pubblicazione: (2025)

MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task
di: Juraska, Juraj, et al.
Pubblicazione: (2025)

Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts
di: Briakou, Eleftheria, et al.
Pubblicazione: (2024)

LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback
di: Xu, Wenda, et al.
Pubblicazione: (2023)

AI-Assisted Human Evaluation of Machine Translation
di: Zouhar, Vilém, et al.
Pubblicazione: (2024)

Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data
di: Finkelstein, Mara, et al.
Pubblicazione: (2024)

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects
di: Deutsch, Daniel, et al.
Pubblicazione: (2025)

Word Alignment as Preference for Machine Translation
di: Wu, Qiyu, et al.
Pubblicazione: (2024)

(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts
di: Wu, Minghao, et al.
Pubblicazione: (2024)

Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy
di: Thompson, Brian, et al.
Pubblicazione: (2024)

Gender Disambiguation in Machine Translation: Diagnostic Evaluation in Decoder-Only Architectures
di: Manna, Chiara, et al.
Pubblicazione: (2026)

Context-Aware Monolingual Human Evaluation of Machine Translation
di: Picinini, Silvio, et al.
Pubblicazione: (2025)

Explainable AI for Sentiment Analysis of Human Metapneumovirus (HMPV) Using XLNet
di: Apu, Md. Shahriar Hossain, et al.
Pubblicazione: (2025)

Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress
di: Proietti, Lorenzo, et al.
Pubblicazione: (2025)

Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model
di: Tomani, Christian, et al.
Pubblicazione: (2023)

Exploring the Correlation between Human and Machine Evaluation of Simultaneous Speech Translation
di: Wang, Xiaoman, et al.
Pubblicazione: (2024)

NeoAMT: Neologism-Aware Agentic Machine Translation with Reinforcement Learning
di: Miao, Zhongtao, et al.
Pubblicazione: (2026)

Hindsight Quality Prediction Experiments in Multi-Candidate Human-Post-Edited Machine Translation
di: Marmonier, Malik, et al.
Pubblicazione: (2026)

On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations?
di: Choenni, Rochelle, et al.
Pubblicazione: (2024)

TranslateGemma Technical Report
di: Finkelstein, Mara, et al.
Pubblicazione: (2026)

Benchmarking Machine Translation on Chinese Social Media Texts
di: Zhao, Kaiyan, et al.
Pubblicazione: (2026)

Feeding Two Birds or Favoring One? Adequacy-Fluency Tradeoffs in Evaluation and Meta-Evaluation of Machine Translation
di: Shayegh, Behzad, et al.
Pubblicazione: (2025)

Remedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling
di: Tan, Shaomu, et al.
Pubblicazione: (2025)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation
di: Kocmi, Tom, et al.
Pubblicazione: (2024)

Testing the Deliteralization Hypothesis in Human and Machine Translation
di: Marmonier, Malik, et al.
Pubblicazione: (2026)

Fluency and Faithfulness in Human and Machine Literary Translation
di: Griebel, Sarah, et al.
Pubblicazione: (2026)

Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results
di: Peter, Jan-Thorsten, et al.
Pubblicazione: (2025)

Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model
di: He, Zhiwei, et al.
Pubblicazione: (2024)

The Comparison of Translationese in Machine Translation and Human Transation in terms of Translation Relations
di: Zhou, Fan
Pubblicazione: (2024)

Cross-lingual Human-Preference Alignment for Neural Machine Translation with Direct Quality Optimization
di: Uhlig, Kaden, et al.
Pubblicazione: (2024)