A Predictive and Synergistic Two-Layer Scheduling Framework for LLM Serving

Documenti analoghi

• FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs
  di: He, Xuan, et al.
  Pubblicazione: (2025)
• Past-Future Scheduler for LLM Serving under SLA Guarantees
  di: Gong, Ruihao, et al.
  Pubblicazione: (2025)
• Slice-Level Scheduling for High Throughput and Load Balanced LLM Serving
  di: Cheng, Ke, et al.
  Pubblicazione: (2024)
• PROSERVE: Unified Multi-Priority Request Scheduling for LLM Serving
  di: Huang, Weizhe, et al.
  Pubblicazione: (2025)
• Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling
  di: Da, Wei, et al.
  Pubblicazione: (2025)