Lethe: Layer- and Time-Adaptive KV Cache Pruning for Reasoning-Intensive LLM Serving

Documenti analoghi

• FastCache: Optimizing Multimodal LLM Serving through Lightweight KV-Cache Compression Framework
  di: Zhu, Jianian, et al.
  Pubblicazione: (2025)
• DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference
  di: Dehghanighobadi, Zahra, et al.
  Pubblicazione: (2026)
• KV-RM: Regularizing KV-Cache Movement for Static-Graph LLM Serving
  di: Zhong, Zhiqing, et al.
  Pubblicazione: (2026)
• Adaptive KV Cache Reuse for Fast Long-Context LLM Serving
  di: li, Fei, et al.
  Pubblicazione: (2026)
• PruneHal: Reducing Hallucinations in Multi-modal Large Language Models through Adaptive KV Cache Pruning
  di: Sun, Fengyuan, et al.
  Pubblicazione: (2025)