Lignende værker

• AntBatchInfer: Elastic Batch Inference in the Kubernetes Cluster
  af: Li, Siyuan, et al.
  Udgivet: (2024)
• FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Serving
  af: Ye, Zihao, et al.
  Udgivet: (2025)
• Mind the Memory Gap: Unveiling GPU Bottlenecks in Large-Batch LLM Inference
  af: Recasens, Pol G., et al.
  Udgivet: (2025)
• Scalable and Cost-Efficient ML Inference: Parallel Batch Processing with Serverless Functions
  af: Barrak, Amine, et al.
  Udgivet: (2025)
• Staggered Batch Scheduling: Co-optimizing Time-to-First-Token and Throughput for High-Efficiency LLM Inference
  af: Tian, Jian, et al.
  Udgivet: (2025)