Image de couverture de livre

Mitigating Posterior Salience Attenuation in Long-Context LLMs with Positional Contrastive Decoding

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Xiao, Zikai, Wang, Ziyang, Ma, Wen, Zhang, Yan, Shen, Wei, Wang, Yan, Gong, Luqi, Liu, Zuozhu
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FairSteer: Inference Time Debiasing for LLMs with Dynamic Activation Steering
par: Li, Yichen, et autres
Publié: (2025)

Large Language Model Bias Mitigation from the Perspective of Knowledge Editing
par: Chen, Ruizhe, et autres
Publié: (2024)

LongWeave: A Long-Form Generation Benchmark Bridging Real-World Relevance and Verifiability
par: Xiao, Zikai, et autres
Publié: (2025)

DCR: Divide-and-Conquer Reasoning for Multi-choice Question Answering with LLMs
par: Meng, Zijie, et autres
Publié: (2024)

PAD: Personalized Alignment of LLMs at Decoding-Time
par: Chen, Ruizhe, et autres
Publié: (2024)

Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding
par: Zhou, Yigeng, et autres
Publié: (2026)

MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMs
par: Wei, Jianhui, et autres
Publié: (2025)

HICT: High-precision 3D CBCT reconstruction from a single X-ray
par: Ma, Wen, et autres
Publié: (2026)

Towards Understanding In-Context Learning with Contrastive Demonstrations and Saliency Maps
par: Liu, Fuxiao, et autres
Publié: (2023)

Structured Prompt Language: Declarative Context Management for LLMs
par: Gong, Wen G.
Publié: (2026)

SurgBench: A Unified Large-Scale Benchmark for Surgical Video Analysis
par: Wei, Jianhui, et autres
Publié: (2025)

Dynamic Attention-Guided Context Decoding for Mitigating Context Faithfulness Hallucinations in Large Language Models
par: Huang, Yanwen, et autres
Publié: (2025)

UIO-LLMs: Unbiased Incremental Optimization for Long-Context LLMs
par: Li, Wenhao, et autres
Publié: (2024)

LiteLong: Resource-Efficient Long-Context Data Synthesis for LLMs
par: Jia, Junlong, et autres
Publié: (2025)

Joint Enhancement of Relational Reasoning for Long-Context LLMs
par: Chen, Zhirui, et autres
Publié: (2025)

Decoding by Contrasting Knowledge: Enhancing LLMs' Confidence on Edited Facts
par: Bi, Baolong, et autres
Publié: (2024)

Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
par: Liu, Xiaoran, et autres
Publié: (2025)

Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models
par: Xie, Tingyu, et autres
Publié: (2023)

Understanding the RoPE Extensions of Long-Context LLMs: An Attention Perspective
par: Zhong, Meizhi, et autres
Publié: (2024)

Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
par: Lin, Hongzhan, et autres
Publié: (2024)

Con-ReCall: Detecting Pre-training Data in LLMs via Contrastive Decoding
par: Wang, Cheng, et autres
Publié: (2024)

Scientific Knowledge-driven Decoding Constraints Improving the Reliability of LLMs
par: Ma, Maotian, et autres
Publié: (2026)

Position: LLMs Can be Good Tutors in English Education
par: Ye, Jingheng, et autres
Publié: (2025)

LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
par: Hu, Zhiyuan, et autres
Publié: (2024)

Knowing or Guessing? Robust Medical Visual Question Answering via Joint Consistency and Contrastive Learning
par: Jiang, Songtao, et autres
Publié: (2025)

DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models
par: Pan, Jiabao, et autres
Publié: (2024)

DynamicKV: Task-Aware Adaptive KV Cache Compression for Long Context LLMs
par: Zhou, Xiabin, et autres
Publié: (2024)

QwenLong-CPRS: Towards $\infty$-LLMs with Dynamic Context Optimization
par: Shen, Weizhou, et autres
Publié: (2025)

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation
par: Phan, Phuc, et autres
Publié: (2024)

Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data
par: Deng, Haoran, et autres
Publié: (2025)

Long-Short Alignment for Effective Long-Context Modeling in LLMs
par: Du, Tianqi, et autres
Publié: (2025)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
par: Xiao, Chaojun, et autres
Publié: (2024)

Do Reasoning LLMs Refuse What They Infer in Long Contexts?
par: Fu, Yu, et autres
Publié: (2026)

MuDAF: Long-Context Multi-Document Attention Focusing through Contrastive Learning on Attention Heads
par: Liu, Weihao, et autres
Publié: (2025)

CNNSum: Exploring Long-Context Summarization with Large Language Models in Chinese Novels
par: Wei, Lingxiao, et autres
Publié: (2024)

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization
par: Sun, Huashan, et autres
Publié: (2025)

Infinite Retrieval: Attention Enhanced LLMs in Long-Context Processing
par: Ye, Xiaoju, et autres
Publié: (2025)

Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding
par: Sennrich, Rico, et autres
Publié: (2023)

3D-RPE: Enhancing Long-Context Modeling Through 3D Rotary Position Encoding
par: Ma, Xindian, et autres
Publié: (2024)

Med-U1: Incentivizing Unified Medical Reasoning in LLMs via Large-scale Reinforcement Learning
par: Zhang, Xiaotian, et autres
Publié: (2025)