Imagen de Portada

Improve Decoding Factuality by Token-wise Cross Layer Entropy of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wu, Jialiang, Shen, Yi, Liu, Sijia, Tang, Yi, Song, Sen, Wang, Xiaoyi, Cai, Longjun
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Enhancing Large Language Model with Decomposed Reasoning for Emotion Cause Pair Extraction
por: Wu, Jialiang, et al.
Publicado: (2024)

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
por: Chuang, Yung-Sung, et al.
Publicado: (2023)

Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models
por: Das, Souvik, et al.
Publicado: (2024)

SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models
por: Zhang, Jianyi, et al.
Publicado: (2024)

Token Constraint Decoding Improves Robustness on Question Answering for Large Language Models
por: Yao, Jui-Ming, et al.
Publicado: (2025)

Integrative Decoding: Improve Factuality via Implicit Self-consistency
por: Cheng, Yi, et al.
Publicado: (2024)

CoViPAL: Layer-wise Contextualized Visual Token Pruning for Large Vision-Language Models
por: Tang, Zicong, et al.
Publicado: (2025)

Alignment-Enhanced Decoding:Defending via Token-Level Adaptive Refining of Probability Distributions
por: Liu, Quan, et al.
Publicado: (2024)

PruneCD: Contrasting Pruned Self Model to Improve Decoding Factuality
por: Yu, Byeongho, et al.
Publicado: (2025)

Token Signature: Predicting Chain-of-Thought Gains with Token Decoding Feature in Large Language Models
por: Liu, Peijie, et al.
Publicado: (2025)

Factuality of Large Language Models: A Survey
por: Wang, Yuxia, et al.
Publicado: (2024)

Dual-Enhancement Product Bundling: Bridging Interactive Graph and Large Language Model
por: Huang, Zhe, et al.
Publicado: (2026)

Adaptive Conformal Prediction for Improving Factuality of Generations by Large Language Models
por: Rubashevskii, Aleksandr, et al.
Publicado: (2026)

LEAF: Learning and Evaluation Augmented by Fact-Checking to Improve Factualness in Large Language Models
por: Tran, Hieu, et al.
Publicado: (2024)

Token-wise Influential Training Data Retrieval for Large Language Models
por: Lin, Huawei, et al.
Publicado: (2024)

Layer-wise Regularized Dropout for Neural Language Models
por: Ni, Shiwen, et al.
Publicado: (2024)

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
por: Xu, Derong, et al.
Publicado: (2024)

Hey, That's My Data! Token-Only Dataset Inference in Large Language Models
por: Xiong, Chen, et al.
Publicado: (2025)

Confidence-Modulated Speculative Decoding for Large Language Models
por: Sen, Jaydip, et al.
Publicado: (2025)

Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs
por: Liu, Xiaoze, et al.
Publicado: (2024)

Follow the Path: Reasoning over Knowledge Graph Paths to Improve Large Language Model Factuality
por: Zhang, Mike, et al.
Publicado: (2025)

EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models
por: Chen, Yuyan, et al.
Publicado: (2024)

FLAME: Factuality-Aware Alignment for Large Language Models
por: Lin, Sheng-Chieh, et al.
Publicado: (2024)

Layer-wise Positional Bias in Short-Context Language Modeling
por: Rahimi, Maryam, et al.
Publicado: (2026)

Factuality Challenges in the Era of Large Language Models
por: Augenstein, Isabelle, et al.
Publicado: (2023)

Reasoning Factual Knowledge in Structured Data with Large Language Models
por: Huang, Sirui, et al.
Publicado: (2024)

Delve into Visual Contrastive Decoding for Hallucination Mitigation of Large Vision-Language Models
por: Lee, Yi-Lun, et al.
Publicado: (2024)

The FACTS Leaderboard: A Comprehensive Benchmark for Large Language Model Factuality
por: Cheng, Aileen, et al.
Publicado: (2025)

Scalable Token-Level Hallucination Detection in Large Language Models
por: Min, Rui, et al.
Publicado: (2026)

iCLP: Large Language Model Reasoning with Implicit Cognition Latent Planning
por: Chen, Sijia, et al.
Publicado: (2025)

DeAL: Decoding-time Alignment for Large Language Models
por: Huang, James Y., et al.
Publicado: (2024)

Large Language Model as a Universal Clinical Multi-task Decoder
por: Wu, Yujiang, et al.
Publicado: (2024)

AlphaToken: Decoupling Adaptation and Stability for Path-Aware Response Token Valuation in LLM Post-Training
por: Qing, Liu, et al.
Publicado: (2026)

Improving Factuality in Large Language Models via Decoding-Time Hallucinatory and Truthful Comparators
por: Yang, Dingkang, et al.
Publicado: (2024)

FactAlign: Long-form Factuality Alignment of Large Language Models
por: Huang, Chao-Wei, et al.
Publicado: (2024)

Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models
por: Yuan, Hongbang, et al.
Publicado: (2024)

IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact
por: Liu, Ruikang, et al.
Publicado: (2024)

One Token Is Enough: Improving Diffusion Language Models with a Sink Token
por: Zhang, Zihou, et al.
Publicado: (2026)

The Factuality of Large Language Models in the Legal Domain
por: Hamdani, Rajaa El, et al.
Publicado: (2024)

Cracking Factual Knowledge: A Comprehensive Analysis of Degenerate Knowledge Neurons in Large Language Models
por: Chen, Yuheng, et al.
Publicado: (2024)