Pyramid Cache: Layer-Adaptive KV Cache Compression with Signature-Based Cold Storage

Documenti analoghi

• PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  di: Cai, Zefan, et al.
  Pubblicazione: (2024)
• PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference
  di: Yang, Dongjie, et al.
  Pubblicazione: (2024)
• The Pitfalls of KV Cache Compression
  di: Chen, Alex, et al.
  Pubblicazione: (2025)
• LightVLM: Acceleraing Large Multimodal Models with Pyramid Token Merging and KV Cache Compression
  di: Hu, Lianyu, et al.
  Pubblicazione: (2025)
• ThinKV: Thought-Adaptive KV Cache Compression for Efficient Reasoning Models
  di: Ramachandran, Akshat, et al.
  Pubblicazione: (2025)