Taming the Titans: A Survey of Efficient LLM Inference Serving

Documenti analoghi

• Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
  di: Agrawal, Amey, et al.
  Pubblicazione: (2024)
• Taming the Memory Footprint Crisis: System Design for Production Diffusion LLM Serving
  di: Fan, Jiakun, et al.
  Pubblicazione: (2025)
• Adacc: An Adaptive Framework Unifying Compression and Activation Recomputation for LLM Training
  di: Chen, Ping, et al.
  Pubblicazione: (2025)
• Cloud Native System for LLM Inference Serving
  di: Xu, Minxian, et al.
  Pubblicazione: (2025)
• Taming Request Imbalance: SLO-Aware Scheduling for Disaggregated LLM Inference
  di: Wang, Qipeng
  Pubblicazione: (2026)