Copertina

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Chen, D'Haro, Luis Fernando, Chen, Yiming, Zhang, Malu, Li, Haizhou
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models
di: Chen, Yiming, et al.
Pubblicazione: (2024)

Commonsense Generation and Evaluation for Dialogue Systems using Large Language Models
di: Estecha-Garitagoitia, Marcos, et al.
Pubblicazione: (2025)

Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialogue
di: Xu, Jiahui, et al.
Pubblicazione: (2024)

Beyond Single-Audio: Advancing Multi-Audio Processing in Audio Large Language Models
di: Chen, Yiming, et al.
Pubblicazione: (2024)

Overview of Dialog System Evaluation Track: Dimensionality, Language, Culture and Safety at DSTC 12
di: Mendonça, John, et al.
Pubblicazione: (2025)

Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models
di: She, Shuaijie, et al.
Pubblicazione: (2023)

DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models
di: Pan, Jiabao, et al.
Pubblicazione: (2024)

Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation
di: Qi, Biqing, et al.
Pubblicazione: (2024)

Mixed-Precision Graph Neural Quantization for Low Bit Large Language Models
di: Liu, Wanlong, et al.
Pubblicazione: (2025)

DRE: An Effective Dual-Refined Method for Integrating Small and Large Language Models in Open-Domain Dialogue Evaluation
di: Zhao, Kun, et al.
Pubblicazione: (2025)

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models
di: Li, Haitao, et al.
Pubblicazione: (2024)

Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Study
di: Fan, Yaxin, et al.
Pubblicazione: (2023)

Evaluating Large Language Models in Analysing Classroom Dialogue
di: Long, Yun, et al.
Pubblicazione: (2024)

Dialogue Language Model with Large-Scale Persona Data Engineering
di: Hong, Mengze, et al.
Pubblicazione: (2024)

Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models
di: Säuberli, Andreas, et al.
Pubblicazione: (2024)

Accounting Reasoning in Large Language Models: Concepts, Evaluation, and Empirical Analysis
di: Zhou, Jie, et al.
Pubblicazione: (2025)

Large Language Models Penetration in Scholarly Writing and Peer Review
di: Zhou, Li, et al.
Pubblicazione: (2025)

OmniEduBench: A Comprehensive Chinese Benchmark for Evaluating Large Language Models in Education
di: Zhang, Min, et al.
Pubblicazione: (2025)

DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models
di: Chen, Kedi, et al.
Pubblicazione: (2024)

A Comprehensive Evaluation on Event Reasoning of Large Language Models
di: Tao, Zhengwei, et al.
Pubblicazione: (2024)

UNO-DST: Leveraging Unlabelled Data in Zero-Shot Dialogue State Tracking
di: Li, Chuang, et al.
Pubblicazione: (2023)

A Comprehensive Evaluation of Large Language Models on Aspect-Based Sentiment Analysis
di: Zhou, Changzhi, et al.
Pubblicazione: (2024)

HalluDial: A Large-Scale Benchmark for Automatic Dialogue-Level Hallucination Evaluation
di: Luo, Wen, et al.
Pubblicazione: (2024)

Rethinking Generative Large Language Model Evaluation for Semantic Comprehension
di: Wei, Fangyun, et al.
Pubblicazione: (2024)

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models
di: Liu, Weize, et al.
Pubblicazione: (2023)

Visualizing Dialogues: Enhancing Image Selection through Dialogue Understanding with Large Language Models
di: Kao, Chang-Sheng, et al.
Pubblicazione: (2024)

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation
di: Zhao, Kun, et al.
Pubblicazione: (2024)

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models
di: Yu, Jing, et al.
Pubblicazione: (2025)

TS-Align: A Teacher-Student Collaborative Framework for Scalable Iterative Finetuning of Large Language Models
di: Zhang, Chen, et al.
Pubblicazione: (2024)

URO-Bench: Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models
di: Yan, Ruiqi, et al.
Pubblicazione: (2025)

Automatic Summarization of Doctor-Patient Encounter Dialogues Using Large Language Model through Prompt Tuning
di: Lyu, Mengxian, et al.
Pubblicazione: (2024)

AttackEval: How to Evaluate the Effectiveness of Jailbreak Attacking on Large Language Models
di: Shu, Dong, et al.
Pubblicazione: (2024)

MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols
di: Du, Yuhao, et al.
Pubblicazione: (2025)

A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industry
di: Huang, Yining, et al.
Pubblicazione: (2024)

JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Models
di: Chen, Michael K., et al.
Pubblicazione: (2025)

Enabling Auditory Large Language Models for Automatic Speech Quality Evaluation
di: Wang, Siyin, et al.
Pubblicazione: (2024)

Scoring with Large Language Models: A Study on Measuring Empathy of Responses in Dialogues
di: Xie, Henry J., et al.
Pubblicazione: (2024)

Toward Automated Qualitative Analysis: Leveraging Large Language Models for Tutoring Dialogue Evaluation
di: Gu, Megan, et al.
Pubblicazione: (2025)

Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models
di: Li, Haoyang, et al.
Pubblicazione: (2025)

PediaBench: A Comprehensive Chinese Pediatric Dataset for Benchmarking Large Language Models
di: Zhang, Qian, et al.
Pubblicazione: (2024)