Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression

Documenti analoghi

• ForesightKV: Optimizing KV Cache Eviction for Reasoning Models by Learning Long-Term Contribution
  di: Dong, Zican, et al.
  Pubblicazione: (2026)
• XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression
  di: Yang, Haoqi, et al.
  Pubblicazione: (2025)
• PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
  di: Cai, Zefan, et al.
  Pubblicazione: (2024)
• KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  di: Liu, Zirui, et al.
  Pubblicazione: (2024)
• Quantization Dominates Rank Reduction for KV-Cache Compression
  di: Salfati, Samuel
  Pubblicazione: (2026)