LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation

Documenti analoghi

• SmallKV: Small Model Assisted Compensation of KV Cache Compression for Efficient LLM Inference
  di: Zhao, Yi, et al.
  Pubblicazione: (2025)
• RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
  di: Zhang, Junkai, et al.
  Pubblicazione: (2026)
• daDPO: Distribution-Aware DPO for Distilling Conversational Abilities
  di: Zhang, Zhengze, et al.
  Pubblicazione: (2025)
• Hierarchical Adaptive Eviction for KV Cache Management in Multimodal Language Models
  di: Ma, Xindian, et al.
  Pubblicazione: (2026)
• RetentiveKV: State-Space Memory for Uncertainty-Aware Multimodal KV Cache Eviction
  di: Liu, Sihao, et al.
  Pubblicazione: (2026)