Cover Image

Steering Information Utility in Key-Value Memory for Language Model Post-Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Deng, Chunyuan, Chang, Ruidi, Chen, Hanjie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Generalization Ridge: Information Flow in Natural Language Generation
by: Chang, Ruidi, et al.
Published: (2025)

Learning Distribution-Wise Control in Representation Space for Language Models
by: Deng, Chunyuan, et al.
Published: (2025)

Language Models are Symbolic Learners in Arithmetic
by: Deng, Chunyuan, et al.
Published: (2024)

Spherical Steering: Geometry-Aware Activation Rotation for Language Models
by: You, Zejia, et al.
Published: (2026)

PRISM: A Dual View of LLM Reasoning through Semantic Flow and Latent Computation
by: Chang, Ruidi, et al.
Published: (2026)

SAFR: Neuron Redistribution for Interpretability
by: Chang, Ruidi, et al.
Published: (2025)

Prompt-Based Value Steering of Large Language Models
by: Abbo, Giulio Antonio, et al.
Published: (2025)

Rethinking Diverse Human Preference Learning through Principal Component Analysis
by: Luo, Feng, et al.
Published: (2025)

Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questions
by: Chen, Hanjie, et al.
Published: (2024)

Painless Activation Steering: An Automated, Lightweight Approach for Post-Training Large Language Models
by: Cui, Sasha, et al.
Published: (2025)

Trellis: Learning to Compress Key-Value Memory in Attention Models
by: Karami, Mahdi, et al.
Published: (2025)

Investigating Data Contamination in Modern Benchmarks for Large Language Models
by: Deng, Chunyuan, et al.
Published: (2023)

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
by: Lin, Zhenghao, et al.
Published: (2025)

Beyond Static Personas: Situational Personality Steering for Large Language Models
by: Wei, Zesheng, et al.
Published: (2026)

On Asymmetric Optimization of Reasoning and Perception in Vision-Language Model Post-Training
by: Wu, Xueqing, et al.
Published: (2026)

Steering Without Side Effects: Improving Post-Deployment Control of Language Models
by: Stickland, Asa Cooper, et al.
Published: (2024)

From Babbling to Fluency: Evaluating the Evolution of Language Models in Terms of Human Language Acquisition
by: Yang, Qiyuan, et al.
Published: (2024)

Steering off Course: Reliability Challenges in Steering Language Models
by: Da Silva, Patrick Queiroz, et al.
Published: (2025)

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs
by: Wang, Pengda, et al.
Published: (2024)

Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers
by: Qiu, Zihan, et al.
Published: (2024)

Post-Training Language Models for Continual Relation Extraction
by: Efeoglu, Sefika, et al.
Published: (2025)

Value Drifts: Tracing Value Alignment During LLM Post-Training
by: Bhatia, Mehar, et al.
Published: (2025)

Unveiling the Spectrum of Data Contamination in Language Models: A Survey from Detection to Remediation
by: Deng, Chunyuan, et al.
Published: (2024)

The Cylindrical Representation Hypothesis for Language Model Steering
by: Gao, Lang, et al.
Published: (2026)

ByteFlow: Language Modeling through Adaptive Byte Compression without a Tokenizer
by: Deng, Chunyuan, et al.
Published: (2026)

SONIC: Segmented Optimized Nexus for Information Compression in Key-Value Caching
by: Chen, Hong, et al.
Published: (2026)

Aggressive Post-Training Compression on Extremely Large Language Models
by: Zhang, Zining, et al.
Published: (2024)

Improved Representation Steering for Language Models
by: Wu, Zhengxuan, et al.
Published: (2025)

Psychological Steering of Large Language Models
by: Blas, Leonardo, et al.
Published: (2026)

Large Language Model based Multi-Agents: A Survey of Progress and Challenges
by: Guo, Taicheng, et al.
Published: (2024)

MuCPT: Music-related Natural Language Model Continued Pretraining
by: Tian, Kai, et al.
Published: (2025)

Decomposition-Enhanced Training for Post-Hoc Attributions In Language Models
by: Balasubramanian, Sriram, et al.
Published: (2025)

Post-Training Language Models for Crosslingual Consistency
by: Liu, Tianyu, et al.
Published: (2026)

COPU: Conformal Prediction for Uncertainty Quantification in Natural Language Generation
by: Wang, Sean, et al.
Published: (2025)

Efficient Continual Learning for Small Language Models with a Discrete Key-Value Bottleneck
by: Diera, Andor, et al.
Published: (2024)

GR-SAP: Generative Replay for Safety Alignment Preservation during Fine-Tuning
by: Fang, Zhouxiang, et al.
Published: (2026)

PASER: Post-Training Data Selection for Efficient Pruned Large Language Model Recovery
by: He, Bowei, et al.
Published: (2025)

Self-Steering Language Models
by: Grand, Gabriel, et al.
Published: (2025)

Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Models
by: Xu, Yilong, et al.
Published: (2025)

Activation Steering for Masked Diffusion Language Models
by: Shnaidman, Adi, et al.
Published: (2025)