WindowKV: Task-Adaptive Group-Wise KV Cache Window Selection for Efficient LLM Inference

Documenti analoghi

• Efficient Long-Context LLM Inference via KV Cache Clustering
  di: Hu, Jie, et al.
  Pubblicazione: (2025)
• WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization
  di: Tao, Wei, et al.
  Pubblicazione: (2026)
• FreeKV: Boosting KV Cache Retrieval for Efficient LLM Inference
  di: Liu, Guangda, et al.
  Pubblicazione: (2025)
• Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference
  di: Feng, Yuan, et al.
  Pubblicazione: (2024)
• KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing
  di: Yang, Yifei, et al.
  Pubblicazione: (2024)