FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs

Documenti analoghi

• Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs
  di: Jiang, Youhe, et al.
  Pubblicazione: (2025)
• BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
  di: Jiang, Youhe, et al.
  Pubblicazione: (2026)
• HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling
  di: Peng, You, et al.
  Pubblicazione: (2026)
• Locality-aware Fair Scheduling in LLM Serving
  di: Cao, Shiyi, et al.
  Pubblicazione: (2025)
• GoodServe: Towards High-Goodput Serving of Agentic LLM Inferences over Heterogeneous Resources
  di: Du, Boxiao, et al.
  Pubblicazione: (2026)