SageSched: Efficient LLM Scheduling Confronting Demand Uncertainty and Hybridity

Documenti analoghi

• Efficient Serving of LLM Applications with Probabilistic Demand Modeling
  di: Liu, Yifei, et al.
  Pubblicazione: (2025)
• S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance
  di: Liu, Di, et al.
  Pubblicazione: (2026)
• PecSched: Preemptive and Efficient Cluster Scheduling for LLM Inference
  di: Zhang, Zeyu, et al.
  Pubblicazione: (2024)
• LLMSched: Uncertainty-Aware Workload Scheduling for Compound LLM Applications
  di: Zhu, Botao, et al.
  Pubblicazione: (2025)
• Towards Resource-Efficient Serverless LLM Inference with SLINFER
  di: Xu, Chuhao, et al.
  Pubblicazione: (2025)