Imagen de Portada

Faithfulness metric fusion: Improving the evaluation of LLM trustworthiness across domains

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Malin, Ben, Kalganova, Tatiana, Boulgouris, Nikolaos
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A review of faithfulness metrics for hallucination assessment in Large Language Models
por: Malin, Ben, et al.
Publicado: (2024)

Incorporating Attribution Importance for Improving Faithfulness Metrics
por: Zhao, Zhixue, et al.
Publicado: (2023)

Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models
por: Zhao, Zhixue, et al.
Publicado: (2024)

Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards
por: Tamber, Manveer Singh, et al.
Publicado: (2025)

Faithfulness Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance
por: Alon, Bar, et al.
Publicado: (2026)

C2-Faith: Benchmarking LLM Judges for Causal and Coverage Faithfulness in Chain-of-Thought Reasoning
por: Mittal, Avni, et al.
Publicado: (2026)

Trustworthiness of Legal Considerations for the Use of LLMs in Education
por: Alaswad, Sara, et al.
Publicado: (2025)

How good is my story? Towards quantitative metrics for evaluating LLM-generated XAI narratives
por: Ichmoukhamedov, Timour, et al.
Publicado: (2024)

Evaluating Human Alignment and Model Faithfulness of LLM Rationale
por: Fayyaz, Mohsen, et al.
Publicado: (2024)

LiTransProQA: an LLM-based Literary Translation evaluation metric with Professional Question Answering
por: Zhang, Ran, et al.
Publicado: (2025)

Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations
por: Quan, Xin, et al.
Publicado: (2025)

Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method
por: Zhao, Tianzhe, et al.
Publicado: (2026)

FaithLens: Detecting and Explaining Faithfulness Hallucination
por: Si, Shuzheng, et al.
Publicado: (2025)

Tell me the truth: A system to measure the trustworthiness of Large Language Models
por: Lipizzi, Carlo
Publicado: (2024)

MAMM-Refine: A Recipe for Improving Faithfulness in Generation with Multi-Agent Collaboration
por: Wan, David, et al.
Publicado: (2025)

A Necessary Step toward Faithfulness: Measuring and Improving Consistency in Free-Text Explanations
por: Zhao, Lingjun, et al.
Publicado: (2025)

Improving Faithfulness of Large Language Models in Summarization via Sliding Generation and Self-Consistency
por: Li, Taiji, et al.
Publicado: (2024)

An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering
por: Murphy, Alexander, et al.
Publicado: (2025)

SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models
por: Lv, Weijiang, et al.
Publicado: (2026)

FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge
por: Yang, Nakyeong, et al.
Publicado: (2025)

GeoFaith: A Spatio-Temporal Dual View of Faithful Chain-of-Thought
por: Lv, Weijiang, et al.
Publicado: (2026)

SI-FACT: Mitigating Knowledge Conflict via Self-Improving Faithfulness-Aware Contrastive Tuning
por: Fu, Shengqiang
Publicado: (2025)

Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
por: Yuan, Wenhao, et al.
Publicado: (2026)

BlackboxNLP-2025 MIB Shared Task: Improving Circuit Faithfulness via Better Edge Selection
por: Nikankin, Yaniv, et al.
Publicado: (2025)

Faithfulness-QA: A Counterfactual Entity Substitution Dataset for Training Context-Faithful RAG Models
por: Ju, Li, et al.
Publicado: (2026)

The illusion of a perfect metric: Why evaluating AI's words is harder than it looks
por: Oliva, Maria Paz, et al.
Publicado: (2025)

Blending Human and LLM Expertise to Detect Hallucinations and Omissions in Mental Health Chatbot Responses
por: Hussain, Khizar, et al.
Publicado: (2026)

Dissociation of Faithful and Unfaithful Reasoning in LLMs
por: Yee, Evelyn, et al.
Publicado: (2024)

STORYSUMM: Evaluating Faithfulness in Story Summarization
por: Subbiah, Melanie, et al.
Publicado: (2024)

Improving Faithfulness of Abstractive Summarization by Controlling Confounding Effect of Irrelevant Sentences
por: Ghoshal, Asish, et al.
Publicado: (2022)

The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models
por: Siegel, Noah Y., et al.
Publicado: (2024)

Faithfulness Evaluation for Decoder-only LLM Attributions with Controlled Retained Information
por: Huang, Xin, et al.
Publicado: (2026)

A Dataset Fusion Algorithm for Generalised Anomaly Detection in Homogeneous Periodic Time Series Datasets
por: Elhalwagy, Ayman, et al.
Publicado: (2023)

Plancraft: an evaluation dataset for planning with LLM agents
por: Dagan, Gautier, et al.
Publicado: (2024)

COGNET-MD, an evaluation framework and dataset for Large Language Model benchmarks in the medical domain
por: Panagoulias, Dimitrios P., et al.
Publicado: (2024)

Counterfactual Simulation Training for Chain-of-Thought Faithfulness
por: Hase, Peter, et al.
Publicado: (2026)

SFR-RAG: Towards Contextually Faithful LLMs
por: Nguyen, Xuan-Phi, et al.
Publicado: (2024)

Faithful Chart Summarization with ChaTS-Pi
por: Krichene, Syrine, et al.
Publicado: (2024)

Faithful Autoformalization via Roundtrip Verification and Repair
por: Amrollahi, Daneshvar, et al.
Publicado: (2026)

Faithfulness and the Notion of Adversarial Sensitivity in NLP Explanations
por: Manna, Supriya, et al.
Publicado: (2024)