Cache Me If You Must: Adaptive Key-Value Quantization for Large Language Models

Documenti analoghi

• Extreme Compression of Large Language Models via Additive Quantization
  di: Egiazarian, Vage, et al.
  Pubblicazione: (2024)
• Hogwild! Inference: Parallel LLM Generation via Concurrent Attention
  di: Rodionov, Gleb, et al.
  Pubblicazione: (2025)
• PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression
  di: Malinovskii, Vladimir, et al.
  Pubblicazione: (2024)
• Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization
  di: Egiazarian, Vage, et al.
  Pubblicazione: (2024)
• WUSH: Near-Optimal Adaptive Transforms for LLM Quantization
  di: Chen, Jiale, et al.
  Pubblicazione: (2025)