Documenti analoghi

• DiffKV: Differentiated Memory Management for Large Language Models with Parallel KV Compaction
  di: Zhang, Yanqi, et al.
  Pubblicazione: (2024)
• KVPR: Efficient LLM Inference with I/O-Aware KV Cache Partial Recomputation
  di: Jiang, Chaoyi, et al.
  Pubblicazione: (2024)
• Leyline: KV Cache Directives for Agentic Inference
  di: Ma, Bole, et al.
  Pubblicazione: (2026)
• Efficient Remote KV Cache Reuse with GPU-native Video Codec
  di: Mi, Liang, et al.
  Pubblicazione: (2026)
• Cost-Efficient LLM Serving in the Cloud: VM Selection with KV Cache Offloading
  di: Kim, Kihyun, et al.
  Pubblicazione: (2025)