SLO-Aware Compute Resource Allocation for Prefill-Decode Disaggregated LLM Inference

Documenti analoghi

• SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
  di: Zhang, Hengrui, et al.
  Pubblicazione: (2025)
• Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving
  di: Shi, Xiaoxiang, et al.
  Pubblicazione: (2025)
• PrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving
  di: Woo, Sunghyeon, et al.
  Pubblicazione: (2026)
• Robust DNN Partitioning and Resource Allocation Under Uncertain Inference Time
  di: Nan, Zhaojun, et al.
  Pubblicazione: (2025)
• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)