Imagen de Portada

KV-CAR: KV Cache Compression using Autoencoders and KV Reuse in Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Roy, Sourjya, Sridharan, Shrihari, Selvam, Surya, Raghunathan, Anand
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Experts are all you need: A Composable Framework for Large Language Model Inference
por: Sridharan, Shrihari, et al.
Publicado: (2025)

Ev-Edge: Efficient Execution of Event-based Vision Algorithms on Commodity Edge Platforms
por: Sridharan, Shrihari, et al.
Publicado: (2024)

ThinKV: Thought-Adaptive KV Cache Compression for Efficient Reasoning Models
por: Ramachandran, Akshat, et al.
Publicado: (2025)

The Pitfalls of KV Cache Compression
por: Chen, Alex, et al.
Publicado: (2025)

CommonKV: Compressing KV Cache with Cross-layer Parameter Sharing
por: Wang, Yixuan, et al.
Publicado: (2025)

EvolKV: Evolutionary KV Cache Compression for LLM Inference
por: Yu, Bohan, et al.
Publicado: (2025)

Training Transformers for KV Cache Compressibility
por: Gelberg, Yoav, et al.
Publicado: (2026)

CacheClip: Accelerating RAG with Effective KV Cache Reuse
por: Yang, Bin, et al.
Publicado: (2025)

KV Pareto: Systems-Level Optimization of KV Cache and Model Compression for Long Context Inference
por: Gokhale, Sai, et al.
Publicado: (2025)

MiniCache: KV Cache Compression in Depth Dimension for Large Language Models
por: Liu, Akide, et al.
Publicado: (2024)

ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression
por: Liu, Guangda, et al.
Publicado: (2024)

SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
por: Zhao, Yi, et al.
Publicado: (2025)

OjaKV: Context-Aware Online Low-Rank KV Cache Compression
por: Zhu, Yuxuan, et al.
Publicado: (2025)

KVSculpt: KV Cache Compression as Distillation
por: Jiang, Bo, et al.
Publicado: (2026)

FastKV: Decoupling of Context Reduction and KV Cache Compression for Prefill-Decoding Acceleration
por: Jo, Dongwon, et al.
Publicado: (2025)

CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving
por: Liu, Yuhan, et al.
Publicado: (2023)

KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
por: Tian, Yuxuan, et al.
Publicado: (2025)

ManifoldKV: Training-Free KV Cache Compression via Euclidean Outlier Detection
por: Datta, Debajyoti, et al.
Publicado: (2026)

RelayCaching: Accelerating LLM Collaboration via Decoding KV Cache Reuse
por: Geng, Yingsheng, et al.
Publicado: (2026)

xKV: Cross-Layer KV-Cache Compression via Aligned Singular Vector Extraction
por: Chang, Chi-Chih, et al.
Publicado: (2025)

GradientSpace: Unsupervised Data Clustering for Improved Instruction Tuning
por: Sridharan, Shrihari, et al.
Publicado: (2025)

Enhancing Large Multimodal Models with Adaptive Sparsity and KV Cache Compression
por: Zhang, Te, et al.
Publicado: (2025)

GPU-Accelerated INT8 Quantization for KV Cache Compression in Large Language Models
por: Taneja, Maanas, et al.
Publicado: (2026)

ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration
por: Yan, Xianglong, et al.
Publicado: (2025)

RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
por: Behnam, Payman, et al.
Publicado: (2025)

AlignedKV: Reducing Memory Access of KV-Cache with Precision-Aligned Quantization
por: Tan, Yifan, et al.
Publicado: (2024)

LongFlow: Efficient KV Cache Compression for Reasoning Models
por: Su, Yi, et al.
Publicado: (2026)

CoKV: Optimizing KV Cache Allocation via Cooperative Game
por: Sun, Qiheng, et al.
Publicado: (2025)

KV Packet: Recomputation-Free Context-Independent KV Caching for LLMs
por: Chen, Chuangtao, et al.
Publicado: (2026)

Inference-Time Hyper-Scaling with KV Cache Compression
por: Łańcucki, Adrian, et al.
Publicado: (2025)

Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression
por: Swain, Kabir, et al.
Publicado: (2026)

Palu: Compressing KV-Cache with Low-Rank Projection
por: Chang, Chi-Chih, et al.
Publicado: (2024)

Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
por: Saxena, Utkarsh, et al.
Publicado: (2024)

Efficient Remote KV Cache Reuse with GPU-native Video Codec
por: Mi, Liang, et al.
Publicado: (2026)

LayerKV: Optimizing Large Language Model Serving with Layer-wise KV Cache Management
por: Xiong, Yi, et al.
Publicado: (2024)

KVCompose: Efficient Structured KV Cache Compression with Composite Tokens
por: Akulov, Dmitry, et al.
Publicado: (2025)

FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference
por: Liu, Guangda, et al.
Publicado: (2025)

MomentKV: Closing the Directional Gap in KV Cache Eviction for Long-Context Inference
por: Li, Yu, et al.
Publicado: (2026)

Quantization Dominates Rank Reduction for KV-Cache Compression
por: Salfati, Samuel
Publicado: (2026)

LouisKV: Efficient KV Cache Retrieval for Long Input-Output Sequences
por: Wu, Wenbo, et al.
Publicado: (2025)