QET: Enhancing Quantized LLM Parameters and KV cache Compression through Element Substitution and Residual Clustering

Documenti analoghi

• Athena: Efficient Block-Wise Post-Training Quantization for Large Language Models Using Second-Order Matrix Derivative Information
  di: Wang, Yanshu, et al.
  Pubblicazione: (2024)
• An experimental study of KV cache reuse strategies in chunk-level caching systems
  di: Cestola, Samuel, et al.
  Pubblicazione: (2026)
• KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference
  di: Tian, Yuxuan, et al.
  Pubblicazione: (2025)
• Quantization Dominates Rank Reduction for KV-Cache Compression
  di: Salfati, Samuel
  Pubblicazione: (2026)
• EvolKV: Evolutionary KV Cache Compression for LLM Inference
  di: Yu, Bohan, et al.
  Pubblicazione: (2025)