Imagen de Portada

Calibrating Model-Based Evaluation Metrics for Summarization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Liu, Hongye, Brahma, Dhanajit, Henao, Ricardo
Formato:	Preprint
Publicado:	2026
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs
por: Wang, Sijia, et al.
Publicado: (2026)

Learning to Substitute Words with Model-based Score Ranking
por: Liu, Hongye, et al.
Publicado: (2025)

Learning to Control Summaries with Score Ranking
por: Liu, Hongye, et al.
Publicado: (2026)

APPLS: Evaluating Evaluation Metrics for Plain Language Summarization
por: Guo, Yue, et al.
Publicado: (2023)

CASPR: Automated Evaluation Metric for Contrastive Summarization
por: Ananthamurugan, Nirupan, et al.
Publicado: (2024)

Coupling Generative Modeling and an Autoencoder with the Causal Bridge
por: Meng, Ruolin, et al.
Publicado: (2025)

Labels have Human Values: Value Calibration of Subjective Tasks
por: Parappan, Mohammed Fayiz, et al.
Publicado: (2026)

A LongFormer-Based Framework for Accurate and Efficient Medical Text Summarization
por: Sun, Dan, et al.
Publicado: (2025)

Polarity Calibration for Opinion Summarization
por: Lei, Yuanyuan, et al.
Publicado: (2024)

Calibration of Large Language Models on Code Summarization
por: Virk, Yuvraj, et al.
Publicado: (2024)

Beyond N-Grams: Rethinking Evaluation Metrics and Strategies for Multilingual Abstractive Summarization
por: Mondshine, Itai, et al.
Publicado: (2025)

Rethinking Scientific Summarization Evaluation: Grounding Explainable Metrics on Facet-aware Benchmark
por: Chen, Xiuying, et al.
Publicado: (2024)

An Automated Length-Aware Quality Metric for Summarization
por: Foland, Andrew D.
Publicado: (2025)

Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages
por: Yari, Amir Hossein, et al.
Publicado: (2025)

Faithful Model Evaluation for Model-Based Metrics
por: Goyal, Palash, et al.
Publicado: (2023)

PlainQAFact: Retrieval-augmented Factual Consistency Evaluation Metric for Biomedical Plain Language Summarization
por: You, Zhiwen, et al.
Publicado: (2025)

Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metric
por: Khosravani, Mohammad, et al.
Publicado: (2024)

Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model
por: Narzary, Sanjib, et al.
Publicado: (2025)

Mitigating the Impact of Reference Quality on Evaluation of Summarization Systems with Reference-Free Metrics
por: Gigant, Théo, et al.
Publicado: (2024)

Redundancy Aware Multi-Reference Based Gainwise Evaluation of Extractive Summarization
por: Akter, Mousumi, et al.
Publicado: (2023)

Argument Summarization and its Evaluation in the Era of Large Language Models
por: Altemeyer, Moritz, et al.
Publicado: (2025)

Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluation
por: Zhang, Ran, et al.
Publicado: (2023)

Full-ECE: A Metric For Token-level Calibration on Large Language Models
por: Liu, Han, et al.
Publicado: (2024)

What's under the hood: Investigating Automatic Metrics on Meeting Summarization
por: Kirstein, Frederic, et al.
Publicado: (2024)

Multi-Dimensional Evaluation of Text Summarization with In-Context Learning
por: Jain, Sameer, et al.
Publicado: (2023)

SteerEval: Inference-time Interventions Strengthen Multilingual Generalization in Neural Summarization Metrics
por: Casola, Silvia, et al.
Publicado: (2026)

CCSBench: Evaluating Compositional Controllability in LLMs for Scientific Document Summarization
por: Ding, Yixi, et al.
Publicado: (2024)

On the Role of Summary Content Units in Text Summarization Evaluation
por: Nawrath, Marcel, et al.
Publicado: (2024)

On Learning to Summarize with Large Language Models as References
por: Liu, Yixin, et al.
Publicado: (2023)

GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration
por: Sung, Yoo Yeon, et al.
Publicado: (2025)

CREAM: Comparison-Based Reference-Free ELO-Ranked Automatic Evaluation for Meeting Summarization
por: Gong, Ziwei, et al.
Publicado: (2024)

Benchmarking Generation and Evaluation Capabilities of Large Language Models for Instruction Controllable Summarization
por: Liu, Yixin, et al.
Publicado: (2023)

Evaluating Small Language Models for News Summarization: Implications and Factors Influencing Performance
por: Xu, Borui, et al.
Publicado: (2025)

Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writers
por: Subbiah, Melanie, et al.
Publicado: (2024)

AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization
por: Afzal, Anum, et al.
Publicado: (2024)

Performance Evaluation of Large Language Models in Bangla Consumer Health Query Summarization
por: Abrar, Ajwad, et al.
Publicado: (2025)

Evaluating LLMs and Pre-trained Models for Text Summarization Across Diverse Datasets
por: Rehman, Tohida, et al.
Publicado: (2025)

WPN: An Unlearning Method Based on N-pair Contrastive Learning in Language Models
por: Chen, Guitao, et al.
Publicado: (2024)

Modeling Motivated Reasoning in Law: Evaluating Strategic Role Conditioning in LLM Summarization
por: Cho, Eunjung, et al.
Publicado: (2025)

Citation-Based Summarization of Landmark Judgments
por: Bindal, Purnima, et al.
Publicado: (2024)