QJL: 1-Bit Quantized JL Transform for KV Cache Quantization with Zero Overhead

Documenti analoghi

• PolarQuant: Quantizing KV Caches with Polar Transformation
  di: Han, Insu, et al.
  Pubblicazione: (2025)
• QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  di: Lin, Yujun, et al.
  Pubblicazione: (2024)
• TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate
  di: Zandieh, Amir, et al.
  Pubblicazione: (2025)
• KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  di: Liu, Zirui, et al.
  Pubblicazione: (2024)
• LogQuant: Log-Distributed 2-Bit Quantization of KV Cache with Superior Accuracy Preservation
  di: Chen, Han, et al.
  Pubblicazione: (2025)