SuperInfer: SLO-Aware Rotary Scheduling and Memory Management for LLM Inference on Superchips

Documenti analoghi

• SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips
  di: Lian, Xinyu, et al.
  Pubblicazione: (2025)
• VoltanaLLM: Feedback-Driven Frequency Control and State-Space Routing for Energy-Efficient LLM Serving
  di: Yu, Jiahuan, et al.
  Pubblicazione: (2025)
• CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
  di: Huang, Shaoyuan, et al.
  Pubblicazione: (2026)
• A Framework for SLO, Carbon, and Wastewater-Aware Sustainable FaaS Cloud Platform Management
  di: Qi, Sirui, et al.
  Pubblicazione: (2024)
• SLO-Aware Scheduling for Large Language Model Inferences
  di: Huang, Jinqi, et al.
  Pubblicazione: (2025)