BanaServe: Unified KV Cache and Dynamic Module Migration for Balancing Disaggregated LLM Serving in AI Infrastructure

Documenti analoghi

• BanaServe: Unified KV Cache and Dynamic Module Migration for Balancing Disaggregated LLM Serving in AI Infrastructure
  di: He, Yiyuan, et al.
  Pubblicazione: (2025)
• Cloudnativesim: A Toolkit for Modeling and Simulation of Cloud‐Native Applications
  di: Jingfeng Wu, et al.
  Pubblicazione: (2025)
• LSRAM: A Lightweight Autoscaling and SLO Resource Allocation Framework for Microservices Based on Gradient Descent
  di: Kan Hu, et al.
  Pubblicazione: (2024)
• C‐Koordinator: Interference‐Aware Management for Large‐Scale and Co‐Located Microservice Clusters
  di: Shengye Song, et al.
  Pubblicazione: (2026)
• Perspectives On Machine Learning Inference Serving in Real‐World Settings
  di: Dennis Muiruri, et al.
  Pubblicazione: (2026)