RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache

Documenti analoghi

• LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation
  di: Shen, Yiqun, et al.
  Pubblicazione: (2025)
• EVICPRESS: Joint KV-Cache Compression and Eviction for Efficient LLM Serving
  di: Feng, Shaoting, et al.
  Pubblicazione: (2025)
• AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations
  di: Tao, Qian, et al.
  Pubblicazione: (2024)
• Hierarchical Adaptive Eviction for KV Cache Management in Multimodal Language Models
  di: Ma, Xindian, et al.
  Pubblicazione: (2026)
• LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation
  di: Ahn, Jinwoo, et al.
  Pubblicazione: (2026)