Cover Image

Lower Layers Matter: Alleviating Hallucination via Multi-Layer Fusion Contrastive Decoding with Truthfulness Refocused

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Dingwei, Fang, Feiteng, Ni, Shiwen, Liang, Feng, Hu, Xiping, Argha, Ahmadreza, Alinejad-Rokny, Hamid, Yang, Min, Li, Chengming
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Expanding before Inferring: Enhancing Factuality in Large Language Models through Premature Layers Interpolation
by: Chen, Dingwei, et al.
Published: (2025)

Layer-wise Regularized Dropout for Neural Language Models
by: Ni, Shiwen, et al.
Published: (2024)

Interpretable graph-based models on multimodal biomedical data integration: A technical review and benchmarking
by: Sadeghi, Alireza, et al.
Published: (2025)

ETAGE: Enhanced Test Time Adaptation with Integrated Entropy and Gradient Norms for Robust Model Performance
by: Shamsi, Afshar, et al.
Published: (2024)

xJailbreak: Representation Space Guided Reinforcement Learning for Interpretable LLM Jailbreaking
by: Lee, Sunbowen, et al.
Published: (2025)

RxSafeBench: Identifying Medication Safety Issues of Large Language Models in Simulated Consultation
by: Zhao, Jiahao, et al.
Published: (2025)

Forgetting before Learning: Utilizing Parametric Arithmetic for Knowledge Updating in Large Language Models
by: Ni, Shiwen, et al.
Published: (2023)

CLinNET: An Interpretable and Uncertainty‐Aware Deep Learning Framework for Multi‐Modal Clinical Genomics
by: Ivan Bakhshayeshi, et al.
Published: (2026)

SemanticST: Spatially Informed Semantic Graph Learning for Clustering, Integration, and Scalable Analysis of Spatial Transcriptomics
by: Zahedi, Roxana, et al.
Published: (2025)

Small Language Model as Data Prospector for Large Language Model
by: Ni, Shiwen, et al.
Published: (2024)

CLaSp: In-Context Layer Skip for Self-Speculative Decoding
by: Chen, Longze, et al.
Published: (2025)

PersonaMath: Boosting Mathematical Reasoning via Persona-Driven Data Augmentation
by: Luo, Jing, et al.
Published: (2024)

CLHA: A Simple yet Effective Contrastive Learning Framework for Human Alignment
by: Fang, Feiteng, et al.
Published: (2024)

PLOT: Enhancing Preference Learning via Optimal Transport
by: Zhu, Liang, et al.
Published: (2026)

Beyond Quantity: Trajectory Diversity Scaling for Code Agents
by: Chen, Guhong, et al.
Published: (2026)

Automatic Paper Reviewing with Heterogeneous Graph Reasoning over LLM-Simulated Reviewer-Author Debates
by: Li, Shuaimin, et al.
Published: (2025)

How chromatin interactions shed light on interpreting non-coding genomic variants: opportunities and future direc-tions
by: Liang, Yuheng, et al.
Published: (2024)

AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents
by: Chen, Guhong, et al.
Published: (2024)

Transcriptomic Models for Immunotherapy Response Prediction Show Limited Cross-cohort Generalisability
by: Liang, Yuheng, et al.
Published: (2026)

Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity
by: Fang, Feiteng, et al.
Published: (2025)

Mitigating Hallucination in Multimodal LLMs with Layer Contrastive Decoding
by: Tong, Bingkui, et al.
Published: (2025)

CollectiveSFT: Scaling Large Language Models for Chinese Medical Benchmark with Collective Instructions in Healthcare
by: Zhu, Jingwei, et al.
Published: (2024)

STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generation
by: Li, Jiaming, et al.
Published: (2025)

Structuring Reasoning for Complex Rules Beyond Flat Representations
by: Yang, Zhihao, et al.
Published: (2025)

TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space
by: Zhang, Shaolei, et al.
Published: (2024)

Octopus: Alleviating Hallucination via Dynamic Contrastive Decoding
by: Suo, Wei, et al.
Published: (2025)

AutoPatent: A Multi-Agent Framework for Automatic Patent Generation
by: Wang, Qiyao, et al.
Published: (2024)

VaLiD: Mitigating the Hallucination of Large Vision Language Models by Visual Layer Fusion Contrastive Decoding
by: Wang, Jiaqi, et al.
Published: (2024)

Training on the Benchmark Is Not All You Need
by: Ni, Shiwen, et al.
Published: (2024)

Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training
by: Fang, Feiteng, et al.
Published: (2024)

Active Layer-Contrastive Decoding Reduces Hallucination in Large Language Model Generation
by: Zhang, Hongxiang, et al.
Published: (2025)

Focal Modulation and Bidirectional Feature Fusion Network for Medical Image Segmentation
by: Safdar, Moin, et al.
Published: (2025)

Enhancing Monte Carlo Dropout Performance for Uncertainty Quantification
by: Asgharnezhad, Hamzeh, et al.
Published: (2025)

CoTJudger: A Graph-Driven Framework for Automatic Evaluation of Chain-of-Thought Efficiency and Redundancy in LRMs
by: Li, Siyi, et al.
Published: (2026)

SC-Arena: A Natural Language Benchmark for Single-Cell Reasoning with Knowledge-Augmented Evaluation
by: Zhao, Jiahao, et al.
Published: (2026)

InteractWeb-Bench: Can Multimodal Agent Escape Blind Execution in Interactive Website Generation?
by: Wang, Qiyao, et al.
Published: (2026)

PatRe: A Full-Stage Office Action and Rebuttal Generation Benchmark for Patent Examination
by: Wang, Qiyao, et al.
Published: (2026)

Quantification of Large Language Model Distillation
by: Lee, Sunbowen, et al.
Published: (2025)

HiST: Histological Images Reconstruct Tumor Spatial Transcriptomics via MultiScale Fusion Deep Learning
by: Wei Li, et al.
Published: (2026)

Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMs
by: Zhang, Xiaofeng, et al.
Published: (2024)