Cover Image

Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bi, Baolong, Liu, Shenghua, Wang, Yiwei, Mei, Lingrui, Fang, Junfeng, Gao, Hongcheng, Ni, Shiyu, Cheng, Xueqi
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

StruEdit: Structured Outputs Enable the Fast and Accurate Knowledge Editing for Large Language Models
by: Bi, Baolong, et al.
Published: (2024)

Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language Models
by: Bi, Baolong, et al.
Published: (2025)

Adaptive Token Biaser: Knowledge Editing via Biasing Key Entities
by: Bi, Baolong, et al.
Published: (2024)

SLANG: New Concept Comprehension of Large Language Models
by: Mei, Lingrui, et al.
Published: (2024)

LPNL: Scalable Link Prediction with Large Language Models
by: Bi, Baolong, et al.
Published: (2024)

Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Facts
by: Bi, Baolong, et al.
Published: (2024)

Can Graph Descriptive Order Affect Solving Graph Problems with LLMs?
by: Ge, Yuyao, et al.
Published: (2024)

Innate Reasoning is Not Enough: In-Context Learning Enhances Reasoning Large Language Models with Less Overthinking
by: Ge, Yuyao, et al.
Published: (2025)

"Not Aligned" is Not "Malicious": Being Careful about Hallucinations of Large Language Models' Jailbreak
by: Mei, Lingrui, et al.
Published: (2024)

HiddenGuard: Fine-Grained Safe Generation with Specialized Representation Router
by: Mei, Lingrui, et al.
Published: (2024)

Context-DPO: Aligning Language Models for Context-Faithfulness
by: Bi, Baolong, et al.
Published: (2024)

Not in Sync: Unveiling Temporal Bias in Audio Chat Models
by: Yao, Jiayu, et al.
Published: (2025)

RefineX: Learning to Refine Pre-training Data at Scale from Expert-Guided Programs
by: Bi, Baolong, et al.
Published: (2025)

How Long Reasoning Chains Influence LLMs' Judgment of Answer Factuality
by: Tu, Minzhu, et al.
Published: (2026)

Who is in the Spotlight: The Hidden Bias Undermining Multimodal Retrieval-Augmented Generation
by: Yao, Jiayu, et al.
Published: (2025)

a1: Steep Test-time Scaling Law via Environment Augmented Generation
by: Mei, Lingrui, et al.
Published: (2025)

Gated Differentiable Working Memory for Long-Context Language Modeling
by: Mei, Lingrui, et al.
Published: (2026)

Focusing by Contrastive Attention: Enhancing VLMs' Visual Reasoning
by: Ge, Yuyao, et al.
Published: (2025)

Prism-$Δ$: Differential Subspace Steering for Prompt Highlighting in Large Language Models
by: Ge, Yuyao, et al.
Published: (2026)

Reward and Guidance through Rubrics: Promoting Exploration to Improve Multi-Domain Reasoning
by: Bi, Baolong, et al.
Published: (2025)

PromptCD: Test-Time Behavior Enhancement via Polarity-Prompt Contrastive Decoding
by: Bi, Baolong, et al.
Published: (2026)

Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception
by: Ni, Shiyu, et al.
Published: (2025)

When Do LLMs Need Retrieval Augmentation? Mitigating LLMs' Overconfidence Helps Retrieval Augmentation
by: Ni, Shiyu, et al.
Published: (2024)

Not Quite Shipshape: How Better Reputations Can Lead to Worse Performance
by: Vinit M. Desai
Published: (2025)

INFACT: A Diagnostic Benchmark for Induced Faithfulness and Factuality Hallucinations in Video-LLMs
by: Yang, Junqi, et al.
Published: (2026)

Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning
by: Liu, Yujian, et al.
Published: (2024)

One SPACE to Rule Them All: Jointly Mitigating Factuality and Faithfulness Hallucinations in LLMs
by: Wang, Pengbo, et al.
Published: (2025)

The Curious Case of Factuality Finetuning: Models' Internal Beliefs Can Improve Factuality
by: Newman, Benjamin, et al.
Published: (2025)

Rethinking All Evidence: Enhancing Trustworthy Retrieval-Augmented Generation via Conflict-Driven Summarization
by: Chen, Juan, et al.
Published: (2025)

From Parameters to Prompts: Understanding and Mitigating the Factuality Gap between Fine-Tuned LLMs
by: Gong, Xuan, et al.
Published: (2025)

How Knowledge Popularity Influences and Enhances LLM Knowledge Boundary Perception
by: Ni, Shiyu, et al.
Published: (2025)

Context-Efficient Retrieval with Factual Decomposition
by: Li, Yanhong, et al.
Published: (2025)

Talking with Tables for Better LLM Factual Data Interactions
by: Oh, Jio, et al.
Published: (2024)

Knowledgeable In-Context Tuning: Exploring and Exploiting Factual Knowledge for In-Context Learning
by: Wang, Jianing, et al.
Published: (2023)

Grounded Visual Factualization: Factual Anchor-Based Finetuning for Enhancing MLLM Factual Consistency
by: Morbiato, Filippo, et al.
Published: (2025)

A Survey of Vibe Coding with Large Language Models
by: Ge, Yuyao, et al.
Published: (2025)

Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Models
by: Xu, Yilong, et al.
Published: (2025)

Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languages
by: Rohera, Pritika, et al.
Published: (2025)

A Survey of Context Engineering for Large Language Models
by: Mei, Lingrui, et al.
Published: (2025)

Persuasion Tokens for Editing Factual Knowledge in LLMs
by: Youssef, Paul, et al.
Published: (2026)