Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Documenti analoghi

• Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs
  di: Mei, Yixuan, et al.
  Pubblicazione: (2026)
• Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs
  di: Jiang, Youhe, et al.
  Pubblicazione: (2025)
• Atlas: Hierarchical Partitioning for Quantum Circuit Simulation on GPUs (Extended Version)
  di: Xu, Mingkuan, et al.
  Pubblicazione: (2024)
• FREESH: Fair, Resource- and Energy-Efficient Scheduling for LLM Serving on Heterogeneous GPUs
  di: He, Xuan, et al.
  Pubblicazione: (2025)
• Disaggregated Prefill and Decoding Inference System for Large Language Model Serving on Multi-Vendor GPUs
  di: Chen, Xing, et al.
  Pubblicazione: (2025)