KV Cache Compression for Inference Efficiency in LLMs: A Review

Documenti analoghi

• Opt-GPTQ: An Optimized GPTQ Combining Sparse Attention and Quantization Techniques
  di: Kong, Jie, et al.
  Pubblicazione: (2025)
• LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms
  di: Kong, Jie, et al.
  Pubblicazione: (2026)
• PackKV: Reducing KV Cache Memory Footprint through LLM-Aware Lossy Compression
  di: Jiang, Bo, et al.
  Pubblicazione: (2025)
• KVComp: A High-Performance, LLM-Aware, Lossy Compression Framework for KV Cache
  di: Jiang, Bo, et al.
  Pubblicazione: (2025)
• FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework
  di: Zhu, Jianian, et al.
  Pubblicazione: (2025)