Cover Image

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Zhen, Xu, Xiaohan, Shen, Tao, Xu, Can, Gu, Jia-Chen, Lai, Yuxuan, Tao, Chongyang, Ma, Shuai
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Re-Reading Improves Reasoning in Large Language Models
by: Xu, Xiaohan, et al.
Published: (2023)

A Survey on Knowledge Distillation of Large Language Models
by: Xu, Xiaohan, et al.
Published: (2024)

Large Language Models Are Active Critics in NLG Evaluation
by: Xu, Shuying, et al.
Published: (2024)

LLMs are Also Effective Embedding Models: An In-depth Overview
by: Tao, Chongyang, et al.
Published: (2024)

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models
by: Chen, Yiming, et al.
Published: (2024)

A Comprehensive Evaluation on Event Reasoning of Large Language Models
by: Tao, Zhengwei, et al.
Published: (2024)

LLM-based NLG Evaluation: Current Status and Challenges
by: Gao, Mingqi, et al.
Published: (2024)

Meta-Task Prompting Elicits Embeddings from Large Language Models
by: Lei, Yibin, et al.
Published: (2024)

Are LLM-based Evaluators Confusing NLG Quality Criteria?
by: Hu, Xinyu, et al.
Published: (2024)

Adam: Dense Retrieval Distillation with Adaptive Dark Examples
by: Tao, Chongyang, et al.
Published: (2022)

OOP: Object-Oriented Programming Evaluation Benchmark for Large Language Models
by: Wang, Shuai, et al.
Published: (2024)

WizardCoder: Empowering Code Large Language Models with Evol-Instruct
by: Luo, Ziyang, et al.
Published: (2023)

Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability
by: Hu, Xinyu, et al.
Published: (2024)

Is Reference Necessary in the Evaluation of NLG Systems? When and Where?
by: Sheng, Shuqian, et al.
Published: (2024)

CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification
by: Li, Yang, et al.
Published: (2022)

Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation
by: Gao, Mingqi, et al.
Published: (2024)

Unveiling Large Language Models Generated Texts: A Multi-Level Fine-Grained Detection Framework
by: Tao, Zhen, et al.
Published: (2024)

NLG Evaluation: Past, Present, Future
by: Reiter, Ehud
Published: (2026)

LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
by: Liusie, Adian, et al.
Published: (2023)

AmbigNLG: Addressing Task Ambiguity in Instruction for NLG
by: Niwa, Ayana, et al.
Published: (2024)

Neighboring Perturbations of Knowledge Editing on Large Language Models
by: Ma, Jun-Yu, et al.
Published: (2024)

Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models
by: Yang, Yuncheng, et al.
Published: (2024)

Leveraging Group Relative Policy Optimization to Advance Large Language Models in Traditional Chinese Medicine
by: Xie, Jiacheng, et al.
Published: (2025)

How to Select Datapoints for Efficient Human Evaluation of NLG Models?
by: Zouhar, Vilém, et al.
Published: (2025)

MCQA-Eval: Efficient Confidence Evaluation in NLG with Gold-Standard Correctness Labels
by: Liu, Xiaoou, et al.
Published: (2025)

CAT-LLM: Style-enhanced Large Language Models with Text Style Definition for Chinese Article-style Transfer
by: Tao, Zhen, et al.
Published: (2024)

Breaking Block Boundaries: Anchor-based History-stable Decoding for Diffusion Large Language Models
by: Zou, Shun, et al.
Published: (2026)

Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators
by: Chang, Jiayi, et al.
Published: (2025)

The statistical advantage of automatic NLG metrics at the system level
by: Wei, Johnny Tian-Zheng, et al.
Published: (2021)

Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
by: Gu, Jia-Chen, et al.
Published: (2024)

WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct
by: Luo, Haipeng, et al.
Published: (2023)

Evaluating Large Language Models for Evidence-Based Clinical Question Answering
by: Wang, Can, et al.
Published: (2025)

DHP Benchmark: Are LLMs Good NLG Evaluators?
by: Wang, Yicheng, et al.
Published: (2024)

AutoWebGLM: A Large Language Model-based Web Navigating Agent
by: Lai, Hanyu, et al.
Published: (2024)

Evaluating the Reversal Curse in Model Editing
by: Xu, Hao-Xiang, et al.
Published: (2023)

AIR: Post-training Data Selection for Reasoning via Attention Head Influence
by: Liu, Jinrui, et al.
Published: (2025)

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References
by: Tang, Tianyi, et al.
Published: (2023)

Playing 20 Question Game with Policy-Based Reinforcement Learning
by: Hu, Huang, et al.
Published: (2018)

EvolSQL: Structure-Aware Evolution for Scalable Text-to-SQL Data Synthesis
by: Pan, Xuanguang, et al.
Published: (2026)

Are Large Language Models Possible to Conduct Cognitive Behavioral Therapy?
by: Shen, Hao, et al.
Published: (2024)