Argus: Token Aware Distributed LLM Inference Optimization

Documenti analoghi

• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)
• Distributed Inference Performance Optimization for LLMs on CPUs
  di: He, Pujiang, et al.
  Pubblicazione: (2024)
• Distributed Generative Inference of LLM at Internet Scales with Multi-Dimensional Communication Optimization
  di: Chen, Jiu, et al.
  Pubblicazione: (2026)
• LLMSched: Uncertainty-Aware Workload Scheduling for Compound LLM Applications
  di: Zhu, Botao, et al.
  Pubblicazione: (2025)
• Argus: Quality-Aware High-Throughput Text-to-Image Inference Serving System
  di: Agarwal, Shubham, et al.
  Pubblicazione: (2025)