LLMSched: Uncertainty-Aware Workload Scheduling for Compound LLM Applications

Documenti analoghi

• Accelerating Compound LLM Training Workloads with Maestro
  di: Yuan, Xiulong, et al.
  Pubblicazione: (2026)
• SageSched: Efficient LLM Scheduling Confronting Demand Uncertainty and Hybridity
  di: Gan, Zhenghao, et al.
  Pubblicazione: (2026)
• S-HPLB: Efficient LLM Attention Serving via Sparsity-Aware Head Parallelism Load Balance
  di: Liu, Di, et al.
  Pubblicazione: (2026)
• PAL: A Variability-Aware Policy for Scheduling ML Workloads in GPU Clusters
  di: Jain, Rutwik, et al.
  Pubblicazione: (2024)
• An Online Fragmentation-Aware Scheduler for Managing GPU-Sharing Workloads on Multi-Instance GPUs
  di: Ting, Hsu-Tzu, et al.
  Pubblicazione: (2025)