AsymKV: Enabling 1-Bit Quantization of KV Cache with Layer-Wise Asymmetric Quantization Configurations

Documenti analoghi

• QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead
  di: Zandieh, Amir, et al.
  Pubblicazione: (2024)
• RDKV: Rate-Distortion Bit Allocation for Joint Eviction and Quantization of the KV Cache
  di: Zhang, Junkai, et al.
  Pubblicazione: (2026)
• RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations
  di: Su, Zunhai, et al.
  Pubblicazione: (2025)
• Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression
  di: Swain, Kabir, et al.
  Pubblicazione: (2026)
• PolarQuant: Quantizing KV Caches with Polar Transformation
  di: Han, Insu, et al.
  Pubblicazione: (2025)