:: Library Catalog

Imagen de Portada

Guardado en:

Detalles Bibliográficos
Autores principales:	Riley, Parker, Deutsch, Daniel, Foster, George, Ratnakar, Viresh, Dabirmoghaddam, Ali, Freitag, Markus
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	https://arxiv.org/abs/2404.01474
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Enhancing Human Evaluation in Machine Translation with Comparative Judgment
por: Song, Yixiao, et al.
Publicado: (2025)

Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data
por: Liu, Zhongtao, et al.
Publicado: (2024)

MQM Re-Annotation: A Technique for Collaborative Evaluation of Machine Translation
por: Riley, Parker, et al.
Publicado: (2025)

From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set
por: Finkelstein, Mara, et al.
Publicado: (2024)

Generating Difficult-to-Translate Texts
por: Zouhar, Vilém, et al.
Publicado: (2025)

Mitigating Metric Bias in Minimum Bayes Risk Decoding
por: Kovacs, Geza, et al.
Publicado: (2024)

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task
por: Juraska, Juraj, et al.
Publicado: (2024)

When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation
por: Xu, Wenda, et al.
Publicado: (2025)

Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation
por: Kocyigit, Muhammed Yusuf, et al.
Publicado: (2025)

MetricX-25 and GemSpanEval: Google Translate Submissions to the WMT25 Evaluation Shared Task
por: Juraska, Juraj, et al.
Publicado: (2025)

Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy
por: Thompson, Brian, et al.
Publicado: (2024)

LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback
por: Xu, Wenda, et al.
Publicado: (2023)

The Chameleon Nature of LLMs: Quantifying Multi-Turn Stance Instability in Search-Enabled Language Models
por: Ratnakar, Shivam, et al.
Publicado: (2025)

Don't Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation
por: DiIanni, Colten, et al.
Publicado: (2025)

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects
por: Deutsch, Daniel, et al.
Publicado: (2025)

Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms
por: Trabelsi, Firas, et al.
Publicado: (2024)

On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluation
por: Briakou, Eleftheria, et al.
Publicado: (2024)

To Diverge or Not to Diverge: A Morphosyntactic Perspective on Machine Translation vs Human Translation
por: Luo, Jiaming, et al.
Publicado: (2024)

STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models
por: Basavatia, Shreyas, et al.
Publicado: (2024)

Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data
por: Finkelstein, Mara, et al.
Publicado: (2024)

Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual Results
por: Peter, Jan-Thorsten, et al.
Publicado: (2025)

TranslateGemma Technical Report
por: Finkelstein, Mara, et al.
Publicado: (2026)

Preliminary Ranking of WMT25 General Machine Translation Systems
por: Kocmi, Tom, et al.
Publicado: (2025)

TyDi QA-WANA: A Benchmark for Information-Seeking Question Answering in Languages of West Asia and North Africa
por: Riley, Parker, et al.
Publicado: (2025)

Replicating Human Social Perception in Generative AI: Evaluating the Valence-Dominance Model
por: Gurkan, Necdet, et al.
Publicado: (2025)

Do LLMs Find Human Answers To Fact-Driven Questions Perplexing? A Case Study on Reddit
por: Seegmiller, Parker, et al.
Publicado: (2024)

HumanRankEval: Automatic Evaluation of LMs as Conversational Assistants
por: Gritta, Milan, et al.
Publicado: (2024)

Left, Right, or Center? Evaluating LLM Framing in News Classification and Generation
por: Kennedy, Molly, et al.
Publicado: (2026)

Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts
por: Briakou, Eleftheria, et al.
Publicado: (2024)

Beyond QA Pairs: Assessing Parameter-Efficient Fine-Tuning for Fact Embedding in LLMs
por: Ratnakar, Shivam, et al.
Publicado: (2025)

You Cannot Feed Two Birds with One Score: the Accuracy-Naturalness Tradeoff in Translation
por: Flamich, Gergely, et al.
Publicado: (2025)

Language Models can Evaluate Themselves via Probability Discrepancy
por: Xia, Tingyu, et al.
Publicado: (2024)

Penalizing Length: Uncovering Systematic Bias in Quality Estimation Metrics
por: Zhang, Yilin, et al.
Publicado: (2025)

MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods
por: Finkelstein, Mara, et al.
Publicado: (2023)

LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs
por: Wu, Tongshuang, et al.
Publicado: (2023)

Feeding Two Birds or Favoring One? Adequacy-Fluency Tradeoffs in Evaluation and Meta-Evaluation of Machine Translation
por: Shayegh, Behzad, et al.
Publicado: (2025)

Interpreting Predictive Probabilities: Model Confidence or Human Label Variation?
por: Baan, Joris, et al.
Publicado: (2024)

Findings of the IWSLT 2024 Evaluation Campaign
por: Ahmad, Ibrahim Said, et al.
Publicado: (2024)

PaperBench: Evaluating AI's Ability to Replicate AI Research
por: Starace, Giulio, et al.
Publicado: (2025)

Preliminary WMT24 Ranking of General MT Systems and LLMs
por: Kocmi, Tom, et al.
Publicado: (2024)