Kitty: Accurate and Efficient 2-bit KV Cache Quantization with Dynamic Channel-wise Precision Boost

Documenti analoghi

• OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
  di: Zhou, Zhongzhu, et al.
  Pubblicazione: (2026)
• SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving
  di: Jia, Jinda, et al.
  Pubblicazione: (2026)
• CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention
  di: Zhou, Zhongzhu, et al.
  Pubblicazione: (2026)
• Understanding and Steering the Cognitive Behaviors of Reasoning Models at Test-Time
  di: Zhang, Zhenyu, et al.
  Pubblicazione: (2025)
• Imitate Optimal Policy: Prevail and Induce Action Collapse in Policy Gradient
  di: Zhou, Zhongzhu, et al.
  Pubblicazione: (2025)