RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory

Documenti analoghi

• Rate-Distortion Theory for Mixed States
  di: Khanian, Zahra Baghali, et al.
  Pubblicazione: (2022)
• PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources
  di: Park, Bumsu, et al.
  Pubblicazione: (2026)
• SQuat: Subspace-orthogonal KV Cache Quantization
  di: Wang, Hao, et al.
  Pubblicazione: (2025)
• WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization
  di: Tao, Wei, et al.
  Pubblicazione: (2026)
• Harmonizing Program Induction with Rate-Distortion Theory
  di: Zhou, Hanqi, et al.
  Pubblicazione: (2024)