MACE: A Hybrid LLM Serving System with Colocated SLO-aware Continuous Retraining Alignment

Documenti analoghi

• AdaServe: Accelerating Multi-SLO LLM Serving with SLO-Customized Speculative Decoding
  di: Li, Zikun, et al.
  Pubblicazione: (2025)
• LeMix: Unified Scheduling for LLM Training and Inference on Multi-GPU Systems
  di: Li, Yufei, et al.
  Pubblicazione: (2025)
• HFX: Joint Design of Algorithms and Systems for Multi-SLO Serving and Fast Scaling
  di: Yousefijamarani, Zahra, et al.
  Pubblicazione: (2025)
• CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
  di: Huang, Shaoyuan, et al.
  Pubblicazione: (2026)
• TinyServe: Query-Aware Cache Selection for Efficient LLM Serving
  di: Liu, Dong, et al.
  Pubblicazione: (2025)