Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation

Documenti analoghi

• Prefill-Decode Aggregation or Disaggregation? Unifying Both for Goodput-Optimized LLM Serving
  di: Wang, Chao, et al.
  Pubblicazione: (2025)
• DualMap: Enabling Both Cache Affinity and Load Balancing for Distributed LLM Serving
  di: Yuan, Ying, et al.
  Pubblicazione: (2026)
• SparseServe: Unlocking Parallelism for Dynamic Sparse Attention in Long-Context LLM Serving
  di: Zhou, Qihui, et al.
  Pubblicazione: (2025)
• DynaServe: Unified and Elastic Execution for Dynamic Disaggregated LLM Serving
  di: Ruan, Chaoyi, et al.
  Pubblicazione: (2025)
• Boosting LLM Serving through Spatial-Temporal GPU Resource Sharing
  di: Lin, Zejia, et al.
  Pubblicazione: (2025)