From Attention to Disaggregation: Tracing the Evolution of LLM Inference

Documenti analoghi

• Janus: Disaggregating Attention and Experts for Scalable MoE Inference
  di: Zhang, Zhexiang, et al.
  Pubblicazione: (2025)
• Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
  di: Hu, Cunchen, et al.
  Pubblicazione: (2024)
• Arrow: Adaptive Scheduling Mechanisms for Disaggregated LLM Inference Architecture
  di: Wu, Yu, et al.
  Pubblicazione: (2025)
• Efficient Multi-round LLM Inference over Disaggregated Serving
  di: He, Wenhao, et al.
  Pubblicazione: (2026)
• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)