A House United Within Itself: SLO-Awareness for On-Premises Containerized ML Inference Clusters via Faro

Documenti analoghi

• SLO-Aware Scheduling for Large Language Model Inferences
  di: Huang, Jinqi, et al.
  Pubblicazione: (2025)
• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)
• Syndeo: Portable Ray Clusters with Secure Containerization
  di: Li, William, et al.
  Pubblicazione: (2024)
• SERFLOW: A Cross-Service Cost Optimization Framework for SLO-Aware Dynamic ML Inference
  di: Zhang, Zongshun, et al.
  Pubblicazione: (2025)
• Performance Characterization of Containerized DNN Training and Inference on Edge Accelerators
  di: K., Prashanthi S., et al.
  Pubblicazione: (2023)