Idleness is Relative: Exploiting Tool-Call Idle Windows for Offloading in Agentic Systems with MORI

Documenti analoghi

• Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
  di: Li, Hanchen, et al.
  Pubblicazione: (2025)
• Towards Efficient and Practical GPU Multitasking in the Era of LLM
  di: Xing, Jiarong, et al.
  Pubblicazione: (2025)
• HeteroPod: XPU-Accelerated Infrastructure Offloading for Commodity Cloud-Native Applications
  di: Yang, Bicheng, et al.
  Pubblicazione: (2025)
• ThunderAgent: A Simple, Fast and Program-Aware Agentic Inference System
  di: Kang, Hao, et al.
  Pubblicazione: (2026)
• Revisiting Cache Freshness for Emerging Real-Time Applications
  di: Mao, Ziming, et al.
  Pubblicazione: (2024)