Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving

Documenti analoghi

• PrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving
  di: Woo, Sunghyeon, et al.
  Pubblicazione: (2026)
• RAPID-Serve: Resource-efficient and Accelerated P/D Intra-GPU Disaggregation
  di: Masood, Amna, et al.
  Pubblicazione: (2026)
• Prefill-Decode Aggregation or Disaggregation? Unifying Both for Goodput-Optimized LLM Serving
  di: Wang, Chao, et al.
  Pubblicazione: (2025)
• SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
  di: Zhang, Hengrui, et al.
  Pubblicazione: (2025)
• DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
  di: Zhong, Yinmin, et al.
  Pubblicazione: (2024)