Image de couverture de livre

KV-Distill: Nearly Lossless Learnable Context Compression for LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chari, Vivek, Qin, Guanghui, Van Durme, Benjamin
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Compactor: Calibrated Query-Agnostic KV Cache Compression with Approximate Leverage Scores
par: Chari, Vivek, et autres
Publié: (2025)

Lossless KV Cache Compression to 2%
par: Yang, Zhen, et autres
Publié: (2024)

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM
par: Kang, Hao, et autres
Publié: (2024)

KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
par: Tian, Yuxuan, et autres
Publié: (2025)

Dodo: Dynamic Contextual Compression for Decoder-only LMs
par: Qin, Guanghui, et autres
Publié: (2023)

ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs
par: Liu, Xin, et autres
Publié: (2025)

KVSculpt: KV Cache Compression as Distillation
par: Jiang, Bo, et autres
Publié: (2026)

SEQR: Secure and Efficient QR-based LoRA Routing
par: Fleshman, William, et autres
Publié: (2025)

LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks
par: Fleshman, William, et autres
Publié: (2025)

SpectR: Dynamically Composing LM Experts with Spectral Routing
par: Fleshman, William, et autres
Publié: (2025)

RE-Adapt: Reverse Engineered Adaptation of Large Language Models
par: Fleshman, William, et autres
Publié: (2024)

Interpreting User Requests in the Context of Natural Language Standing Instructions
par: Moghe, Nikita, et autres
Publié: (2023)

LM Agents for Coordinating Multi-User Information Gathering
par: Jhamtani, Harsh, et autres
Publié: (2025)

AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees
par: Fleshman, William, et autres
Publié: (2024)

OjaKV: Context-Aware Online Low-Rank KV Cache Compression
par: Zhu, Yuxuan, et autres
Publié: (2025)

FreqKV: Key-Value Compression in Frequency Domain for Context Window Extension
par: Kai, Jushi, et autres
Publié: (2025)

Language Models and Logic Programs for Trustworthy Tax Reasoning
par: Jurayj, William, et autres
Publié: (2025)

KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
par: Li, Xing, et autres
Publié: (2025)

LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error
par: Wang, Boshi, et autres
Publié: (2024)

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation
par: Fleshman, William, et autres
Publié: (2024)

R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
par: Cai, Zefan, et autres
Publié: (2025)

PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
par: Cai, Zefan, et autres
Publié: (2024)

SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responses
par: Jiang, Dongwei, et autres
Publié: (2024)

DeltaKV: Residual-Based KV Cache Compression via Long-Range Similarity
par: Hao, Jitai, et autres
Publié: (2026)

Crystal: Characterizing Relative Impact of Scholarly Publications
par: Collison, Hannah, et autres
Publié: (2026)

HeteroCache: A Dynamic Retrieval Approach to Heterogeneous KV Cache Compression for Long-Context LLM Inference
par: Shi, Zhiyuan, et autres
Publié: (2026)

SampleAttention: Near-Lossless Acceleration of Long Context LLM Inference with Adaptive Structured Sparse Attention
par: Zhu, Qianchao, et autres
Publié: (2024)

HCAttention: Extreme KV Cache Compression via Heterogeneous Attention Computing for LLMs
par: Yang, Dongquan, et autres
Publié: (2025)

DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference
par: Dehghanighobadi, Zahra, et autres
Publié: (2026)

Reframing Tax Law Entailment as Analogical Reasoning
par: Zou, Xinrui, et autres
Publié: (2024)

Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements
par: Zhang, Jingyu, et autres
Publié: (2024)

Lossless Token Sequence Compression via Meta-Tokens
par: Harvill, John, et autres
Publié: (2025)

SurfaceLogicKV: Surface and Logic Attention Behaviors are All You Need for Robust KV Cache Compression
par: Li, Mengjie, et autres
Publié: (2025)

MatryoshkaKV: Adaptive KV Compression via Trainable Orthogonal Projection
par: Lin, Bokai, et autres
Publié: (2024)

KV Cache Steering for Controlling Frozen LLMs
par: Belitsky, Max, et autres
Publié: (2025)

Always Tell Me The Odds: Fine-grained Conditional Probability Estimation
par: Wang, Liaoyaqi, et autres
Publié: (2025)

CommVQ: Commutative Vector Quantization for KV Cache Compression
par: Li, Junyan, et autres
Publié: (2025)

Leveraging KV Similarity for Online Structured Pruning in LLMs
par: Lee, Jungmin, et autres
Publié: (2025)

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy
par: Zhang, Rongzhi, et autres
Publié: (2024)

KVReviver: Reversible KV Cache Compression with Sketch-Based Token Reconstruction
par: Yuan, Aomufei, et autres
Publié: (2025)