Documenti analoghi

• SiPipe: Bridging the CPU-GPU Utilization Gap for Efficient Pipeline-Parallel LLM Inference
  di: He, Yongchao, et al.
  Pubblicazione: (2025)
• CascadeInfer: Length-Aware Scheduling of LLM Serving with Low Latency and Load Balancing
  di: Yuan, Yitao, et al.
  Pubblicazione: (2025)
• Efficient Multi-round LLM Inference over Disaggregated Serving
  di: He, Wenhao, et al.
  Pubblicazione: (2026)
• Nexus:Proactive Intra-GPU Disaggregation of Prefill and Decode in LLM Serving
  di: Shi, Xiaoxiang, et al.
  Pubblicazione: (2025)
• DynaServe: Unified and Elastic Execution for Dynamic Disaggregated LLM Serving
  di: Ruan, Chaoyi, et al.
  Pubblicazione: (2025)