Lignende værker

• TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
  af: Zhang, Hongbin, et al.
  Udgivet: (2025)
• AlignedServe: Orchestrating Prefix-aware Batching to Build a High-throughput and Computing-efficient LLM Serving System
  af: Bai, Fengyao, et al.
  Udgivet: (2026)
• gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
  af: Guo, Tianyu, et al.
  Udgivet: (2025)
• PipeMax: Enhancing Offline LLM Inference on Commodity GPU Servers
  af: Zhang, Hongbin, et al.
  Udgivet: (2026)
• EcoServe: Designing Carbon-Aware AI Inference Systems
  af: Li, Yueying, et al.
  Udgivet: (2025)