A Method for Building Large Language Models with Predefined KV Cache Capacity

Documenti analoghi

• dKV-Cache: The Cache for Diffusion Language Models
  di: Ma, Xinyin, et al.
  Pubblicazione: (2025)
• KVLink: Accelerating Large Language Models via Efficient KV Cache Reuse
  di: Yang, Jingbo, et al.
  Pubblicazione: (2025)
• SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers
  di: Tang, Zicong, et al.
  Pubblicazione: (2025)
• RetentiveKV: State-Space Memory for Uncertainty-Aware Multimodal KV Cache Eviction
  di: Liu, Sihao, et al.
  Pubblicazione: (2026)
• Layer-Condensed KV Cache for Efficient Inference of Large Language Models
  di: Wu, Haoyi, et al.
  Pubblicazione: (2024)