PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs

Documenti analoghi

• Evaluating Quantized Large Language Models
  di: Li, Shiyao, et al.
  Pubblicazione: (2024)
• MixKVQ: Query-Aware Mixed-Precision KV Cache Quantization for Long-Context Reasoning
  di: Zhang, Tao, et al.
  Pubblicazione: (2025)
• CSKV: Training-Efficient Channel Shrinking for KV Cache in Long-Context Scenarios
  di: Wang, Luning, et al.
  Pubblicazione: (2024)
• FrameFusion: Combining Similarity and Importance for Video Token Reduction on Large Vision Language Models
  di: Fu, Tianyu, et al.
  Pubblicazione: (2024)
• ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
  di: Zhao, Tianchen, et al.
  Pubblicazione: (2024)