:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Downie, Jonathan, Moorkens, Joss
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	https://arxiv.org/abs/2601.05864
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Training in translation tools and technologies: Findings of the EMT survey 2023
by: Rothwell, Andrew, et al.
Published: (2025)

Sociotechnical Effects of Machine Translation
by: Moorkens, Joss, et al.
Published: (2025)

Extending CREAMT: Leveraging Large Language Models for Literary Translation Post-Editing
by: Castaldo, Antonio, et al.
Published: (2025)

An Automatic Quality Metric for Evaluating Simultaneous Interpretation
by: Makinae, Mana, et al.
Published: (2024)

CASPR: Automated Evaluation Metric for Contrastive Summarization
by: Ananthamurugan, Nirupan, et al.
Published: (2024)

What makes a good metric? Evaluating automatic metrics for text-to-image consistency
by: Ross, Candace, et al.
Published: (2024)

PEEM: Prompt Engineering Evaluation Metrics for Interpretable Joint Evaluation of Prompts and Responses
by: Hong, Minki, et al.
Published: (2026)

Beyond Correlation: Interpretable Evaluation of Machine Translation Metrics
by: Perrella, Stefano, et al.
Published: (2024)

NovAScore: A New Automated Metric for Evaluating Document Level Novelty
by: Ai, Lin, et al.
Published: (2024)

PIER: A Novel Metric for Evaluating What Matters in Code-Switching
by: Ugan, Enes Yavuz, et al.
Published: (2025)

An Analysis on Automated Metrics for Evaluating Japanese-English Chat Translation
by: Rusli, Andre, et al.
Published: (2024)

*-PLUIE: Personalisable metric with Llm Used for Improved Evaluation
by: Lemesle, Quentin, et al.
Published: (2026)

Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation
by: Luo, Kangcheng, et al.
Published: (2025)

Model Utility Law: Evaluating LLMs beyond Performance through Mechanism Interpretable Metric
by: Cao, Yixin, et al.
Published: (2025)

Agreement Metrics for LLM-as-Judge Evaluation: What to Report and Why
by: Rao, Delip, et al.
Published: (2026)

An Automated Length-Aware Quality Metric for Summarization
by: Foland, Andrew D.
Published: (2025)

A Measure of the System Dependence of Automated Metrics
by: von Däniken, Pius, et al.
Published: (2024)

What does it mean to understand language?
by: Casto, Colton, et al.
Published: (2025)

A Paradigm for Interpreting Metrics and Identifying Critical Errors in Automatic Speech Recognition
by: Bañeras-Roux, Thibault, et al.
Published: (2026)

Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
by: Jalouzot, Louis, et al.
Published: (2024)

A Multimodal Automated Interpretability Agent
by: Shaham, Tamar Rott, et al.
Published: (2024)

Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy
by: Deviyani, Athiya, et al.
Published: (2025)

Evaluating the Evaluators: Are readability metrics good measures of readability?
by: Cachola, Isabel, et al.
Published: (2025)

Clinically Grounded Agent-based Report Evaluation: An Interpretable Metric for Radiology Report Generation
by: Dua, Radhika, et al.
Published: (2025)

Compared to What? Baselines and Metrics for Counterfactual Prompting
by: Yang, Zihao, et al.
Published: (2026)

What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Gaussian-Noise-free Text-Image Corruption and Evaluation
by: Golovanevsky, Michal, et al.
Published: (2024)

Claim Extraction for Fact-Checking: Data, Models, and Automated Metrics
by: Ullrich, Herbert, et al.
Published: (2025)

Enhancing Automated Interpretability with Output-Centric Feature Descriptions
by: Gur-Arieh, Yoav, et al.
Published: (2025)

What distinguishes conspiracy from critical narratives? A computational analysis of oppositional discourse
by: Korenčić, Damir, et al.
Published: (2024)

APPLS: Evaluating Evaluation Metrics for Plain Language Summarization
by: Guo, Yue, et al.
Published: (2023)

Do they mean 'us'? Interpreting Referring Expressions in Intergroup Bias
by: Govindarajan, Venkata S, et al.
Published: (2024)

Evaluating Metrics for Bias in Word Embeddings
by: Schröder, Sarah, et al.
Published: (2021)

What do Large Language Models Need for Machine Translation Evaluation?
by: Qian, Shenbin, et al.
Published: (2024)

A Third Paradigm for LLM Evaluation: Dialogue Game-Based Evaluation using clembench
by: Schlangen, David, et al.
Published: (2025)

Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics?
by: Mukherjee, Sourabrata, et al.
Published: (2025)

Automated Semantic Rules Detection (ASRD) for Emergent Communication Interpretation
by: Vanderplaetse, Bastien, et al.
Published: (2026)

gec-metrics: A Unified Library for Grammatical Error Correction Evaluation
by: Goto, Takumi, et al.
Published: (2025)

Comparative Experimentation of Accuracy Metrics in Automated Medical Reporting: The Case of Otitis Consultations
by: Faber, Wouter, et al.
Published: (2023)

Calibrating Model-Based Evaluation Metrics for Summarization
by: Liu, Hongye, et al.
Published: (2026)

Reference-free Evaluation Metrics for Text Generation: A Survey
by: Ito, Takumi, et al.
Published: (2025)