Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

Documenti analoghi

• Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow
  di: Mei, Yixuan, et al.
  Pubblicazione: (2024)
• Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs
  di: Jiang, Youhe, et al.
  Pubblicazione: (2025)
• BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization
  di: Jiang, Youhe, et al.
  Pubblicazione: (2026)
• FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs
  di: He, Xuan, et al.
  Pubblicazione: (2025)
• Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs (Extended Version)
  di: Xu, Mingkuan, et al.
  Pubblicazione: (2024)