SIMPLE: Disaggregating Sampling from GPU Inference into a Decision Plane for Faster Distributed LLM Serving

Documenti analoghi

• SiPipe: Bridging the CPU-GPU Utilization Gap for Efficient Pipeline-Parallel LLM Inference
  di: He, Yongchao, et al.
  Pubblicazione: (2025)
• CascadeInfer: Length-Aware Scheduling of LLM Serving with Low Latency and Load Balancing
  di: Yuan, Yitao, et al.
  Pubblicazione: (2025)
• Efficient Multi-round LLM Inference over Disaggregated Serving
  di: He, Wenhao, et al.
  Pubblicazione: (2026)
• DOPD: A Dynamic PD-Disaggregation Architecture for Maximizing Goodput in LLM Inference Serving
  di: Liao, Junhan, et al.
  Pubblicazione: (2025)
• DynaServe: Unified and Elastic Execution for Dynamic Disaggregated LLM Serving
  di: Ruan, Chaoyi, et al.
  Pubblicazione: (2025)