Imagen de Portada

Are LLM-based Evaluators Confusing NLG Quality Criteria?

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hu, Xinyu, Gao, Mingqi, Hu, Sen, Zhang, Yang, Chen, Yicheng, Xu, Teng, Wan, Xiaojun
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators
por: Chang, Jiayi, et al.
Publicado: (2025)

LLM-based NLG Evaluation: Current Status and Challenges
por: Gao, Mingqi, et al.
Publicado: (2024)

Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation
por: Gao, Mingqi, et al.
Publicado: (2024)

Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability
por: Hu, Xinyu, et al.
Publicado: (2024)

A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability
por: Hu, Xinyu, et al.
Publicado: (2025)

Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling
por: Ruan, Jie, et al.
Publicado: (2024)

Aspect-Guided Multi-Level Perturbation Analysis of Large Language Models in Automated Peer Review
por: Li, Jiatao, et al.
Publicado: (2025)

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference
por: Gao, Mingqi, et al.
Publicado: (2024)

MINOS: A Multimodal Evaluation Model for Bidirectional Generation Between Image and Text
por: Zhang, Junzhe, et al.
Publicado: (2025)

Large Language Models Are Active Critics in NLG Evaluation
por: Xu, Shuying, et al.
Publicado: (2024)

Integration of LLM Quality Assurance into an NLG System
por: Chen, Ching-Yi, et al.
Publicado: (2025)

Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation
por: Ruan, Jie, et al.
Publicado: (2024)

DHP Benchmark: Are LLMs Good NLG Evaluators?
por: Wang, Yicheng, et al.
Publicado: (2024)

SCOPE: Intrinsic Semantic Space Control for Mitigating Copyright Infringement in LLMs
por: Zhang, Zhenliang, et al.
Publicado: (2025)

Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models
por: Li, Jiatao, et al.
Publicado: (2024)

SMART-RAG: Selection using Determinantal Matrices for Augmented Retrieval
por: Li, Jiatao, et al.
Publicado: (2024)

CFunModel: A "Funny" Language Model Capable of Chinese Humor Generation and Processing
por: Yu, Zhenghan, et al.
Publicado: (2025)

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
por: Li, Zhen, et al.
Publicado: (2024)

NLG Evaluation: Past, Present, Future
por: Reiter, Ehud
Publicado: (2026)

TacoMAS: Test-Time Co-Evolution of Topology and Capability in LLM-based Multi-Agent Systems
por: Xu, Chen, et al.
Publicado: (2026)

AmbigNLG: Addressing Task Ambiguity in Instruction for NLG
por: Niwa, Ayana, et al.
Publicado: (2024)

Is Reference Necessary in the Evaluation of NLG Systems? When and Where?
por: Sheng, Shuqian, et al.
Publicado: (2024)

Error-Robust Retrieval for Chinese Spelling Check
por: Yin, Xunjian, et al.
Publicado: (2022)

CE-RM: A Pointwise Generative Reward Model Optimized via Two-Stage Rollout and Unified Criteria
por: Hu, Xinyu, et al.
Publicado: (2026)

LLMSR@XLLM25: An Empirical Study of LLM for Structural Reasoning
por: Li, Xinye, et al.
Publicado: (2025)

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References
por: Tang, Tianyi, et al.
Publicado: (2023)

Exploring Causal Effect of Social Bias on Faithfulness Hallucinations in Large Language Models
por: Zhang, Zhenliang, et al.
Publicado: (2025)

GAP: Graph-Assisted Prompts for Dialogue-based Medication Recommendation
por: Zhong, Jialun, et al.
Publicado: (2025)

ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMs
por: Zhang, Zhenliang, et al.
Publicado: (2025)

How to Select Datapoints for Efficient Human Evaluation of NLG Models?
por: Zouhar, Vilém, et al.
Publicado: (2025)

SAGEval: The frontiers of Satisfactory Agent based NLG Evaluation for reference-free open-ended text
por: Ghosh, Reshmi, et al.
Publicado: (2024)

Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models
por: Chen, Xiang, et al.
Publicado: (2023)

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models
por: Chen, Yiming, et al.
Publicado: (2024)

LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
por: Liusie, Adian, et al.
Publicado: (2023)

Bayesian Calibration of Win Rate Estimation with LLM Evaluators
por: Gao, Yicheng, et al.
Publicado: (2024)

OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMs
por: Kartáč, Ivan, et al.
Publicado: (2025)

HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy
por: Xu, Fan, et al.
Publicado: (2025)

BiT-MCTS: A Theme-based Bidirectional MCTS Approach to Chinese Fiction Generation
por: Li, Zhaoyi, et al.
Publicado: (2026)

MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency
por: Zhang, Junzhe, et al.
Publicado: (2024)

Confusion-Aware Rubric Optimization for LLM-based Automated Grading
por: Chu, Yucheng, et al.
Publicado: (2026)