Buchumschlag

Diagnosing Failures in Large Language Models' Answers: Integrating Error Attribution into Evaluation Framework

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Xu, Zishan, Xie, Shuyi, Lv, Qingsong, Xiao, Shupei, Song, Linlin, Wenjuan, Sui, Lin, Fan
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Computation and Language
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation
von: Lin, Fan, et al.
Veröffentlicht: (2024)

Integrated Framework for LLM Evaluation with Answer Generation
von: Lee, Sujeong, et al.
Veröffentlicht: (2025)

CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction
von: Ye, Jingheng, et al.
Veröffentlicht: (2024)

Enhancing Answer Attribution for Faithful Text Generation with Large Language Models
von: Vladika, Juraj, et al.
Veröffentlicht: (2024)

RAISE: Reinforced Adaptive Instruction Selection For Large Language Models
von: Lv, Qingsong, et al.
Veröffentlicht: (2025)

Thinking in Many Modes: How Composite Reasoning Elevates Large Language Model Performance with Limited Data
von: Ahmad, Zishan, et al.
Veröffentlicht: (2025)

ErrorMap and ErrorAtlas: Charting the Failure Landscape of Large Language Models
von: Ashury-Tahan, Shir, et al.
Veröffentlicht: (2026)

Learning to Diagnose and Correct Errors: Towards Moral Sensitivity Acquisition in Large Language Models
von: Chen, Bocheng, et al.
Veröffentlicht: (2026)

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models
von: Qin, Zhanyue, et al.
Veröffentlicht: (2024)

A Context-Aware Dual-Metric Framework for Confidence Estimation in Large Language Models
von: Yuan, Mingruo, et al.
Veröffentlicht: (2025)

Exploring Multilingual Concepts of Human Value in Large Language Models: Is Value Alignment Consistent, Transferable and Controllable across Languages?
von: Xu, Shaoyang, et al.
Veröffentlicht: (2024)

ErrorRadar: Benchmarking Complex Mathematical Reasoning of Multimodal Large Language Models Via Error Detection
von: Yan, Yibo, et al.
Veröffentlicht: (2024)

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration
von: Wu, Kangxi, et al.
Veröffentlicht: (2024)

Evaluating Nuanced Bias in Large Language Model Free Response Answers
von: Healey, Jennifer, et al.
Veröffentlicht: (2024)

DATE-LM: Benchmarking Data Attribution Evaluation for Large Language Models
von: Jiao, Cathy, et al.
Veröffentlicht: (2025)

Reasoning or Retrieval? A Study of Answer Attribution on Large Reasoning Models
von: Wang, Yuhui, et al.
Veröffentlicht: (2025)

Attributional Safety Failures in Large Language Models under Code-Mixed Perturbations
von: Banerjee, Somnath, et al.
Veröffentlicht: (2025)

Hallucination Detection: Robustly Discerning Reliable Answers in Large Language Models
von: Chen, Yuyan, et al.
Veröffentlicht: (2024)

From Token to Line: Enhancing Code Generation with a Long-Term Perspective
von: Lu, Tingwei, et al.
Veröffentlicht: (2025)

MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems
von: Deng, Xinle, et al.
Veröffentlicht: (2026)

SAS-Bench: A Fine-Grained Benchmark for Evaluating Short Answer Scoring with Large Language Models
von: Lai, Peichao, et al.
Veröffentlicht: (2025)

Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer
von: Kahana, Adar, et al.
Veröffentlicht: (2024)

SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation
von: Zhao, Kun, et al.
Veröffentlicht: (2024)

Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models
von: Yin, Zhangyue, et al.
Veröffentlicht: (2024)

Talent or Luck? Evaluating Attribution Bias in Large Language Models
von: Raj, Chahat, et al.
Veröffentlicht: (2025)

Large Language Model Reasoning Failures
von: Song, Peiyang, et al.
Veröffentlicht: (2026)

Attribute or Abstain: Large Language Models as Long Document Assistants
von: Buchmann, Jan, et al.
Veröffentlicht: (2024)

Finding Answers in Thought Matters: Revisiting Evaluation on Large Language Models with Reasoning
von: Jo, Hwiyeol, et al.
Veröffentlicht: (2025)

Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications
von: Su, Guangxin, et al.
Veröffentlicht: (2025)

Revisiting Classification Taxonomy for Grammatical Errors
von: Zou, Deqing, et al.
Veröffentlicht: (2025)

ExpertQA: Expert-Curated Questions and Attributed Answers
von: Malaviya, Chaitanya, et al.
Veröffentlicht: (2023)

BioACE: An Automated Framework for Biomedical Answer and Citation Evaluations
von: Gupta, Deepak, et al.
Veröffentlicht: (2026)

Advancing Large Language Model Attribution through Self-Improving
von: Huang, Lei, et al.
Veröffentlicht: (2024)

Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning
von: Gu, Zishan, et al.
Veröffentlicht: (2024)

DataAgent: Evaluating Large Language Models' Ability to Answer Zero-Shot, Natural Language Queries
von: Mishra, Manit, et al.
Veröffentlicht: (2024)

LLM-as-a-Grader: Practical Insights from Large Language Model for Short-Answer and Report Evaluation
von: Byun, Grace, et al.
Veröffentlicht: (2025)

SciCustom: A Framework for Custom Evaluation of Scientific Capabilities in Large Language Models
von: Gu, Yiyang, et al.
Veröffentlicht: (2026)

Knowledge Tagging with Large Language Model based Multi-Agent System
von: Li, Hang, et al.
Veröffentlicht: (2024)

Evaluation of Attribution Bias in Generator-Aware Retrieval-Augmented Large Language Models
von: Abolghasemi, Amin, et al.
Veröffentlicht: (2024)

CtrlRAG: Black-box Document Poisoning Attacks for Retrieval-Augmented Generation of Large Language Models
von: Sui, Runqi
Veröffentlicht: (2025)