RAPID-Serve: Resource-efficient and Accelerated P/D Intra-GPU Disaggregation

Documenti analoghi

• Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving
  di: Shi, Xiaoxiang, et al.
  Pubblicazione: (2025)
• P/D-Serve: Serving Disaggregated Large Language Model at Scale
  di: Jin, Yibo, et al.
  Pubblicazione: (2024)
• Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation
  di: Liang, Yunkai, et al.
  Pubblicazione: (2025)
• Enabling Disaggregated Multi-Stage MLLM Inference via GPU-Internal Scheduling and Resource Sharing
  di: Zhao, Lingxiao, et al.
  Pubblicazione: (2025)
• BestServe: Serving Strategies with Optimal Goodput in Collocation and Disaggregation Architectures
  di: Hu, Xiannan, et al.
  Pubblicazione: (2025)