BanaServe: Unified KV Cache and Dynamic Module Migration for Balancing Disaggregated LLM Serving in AI Infrastructure

Documenti analoghi

• BanaServe: Unified KV Cache and Dynamic Module Migration for Balancing Disaggregated LLM Serving in AI Infrastructure
  di: Yiyuan He, et al.
  Pubblicazione: (2026)
• UELLM: A Unified and Efficient Approach for LLM Inference Serving
  di: He, Yiyuan, et al.
  Pubblicazione: (2024)
• Unlock the Potential of Fine-grained LLM Serving via Dynamic Module Scaling
  di: Wu, Jingfeng, et al.
  Pubblicazione: (2025)
• Cloud Native System for LLM Inference Serving
  di: Xu, Minxian, et al.
  Pubblicazione: (2025)
• BrownoutServe: SLO-Aware Inference Serving under Bursty Workloads for MoE-based LLMs
  di: Hu, Jianmin, et al.
  Pubblicazione: (2025)