Taming the Memory Footprint Crisis: System Design for Production Diffusion LLM Serving

Documenti analoghi

• APEX: Asynchronous Parallel CPU-GPU Execution for Online LLM Inference on Constrained GPUs
  di: Fan, Jiakun, et al.
  Pubblicazione: (2025)
• Serving Chain-structured Jobs with Large Memory Footprints with Application to Large Foundation Model Serving
  di: Sun, Tingyang, et al.
  Pubblicazione: (2026)
• FACT: Compositional Kernel Synthesis with a Three-Stage Agentic Workflow
  di: Heidari, Sina, et al.
  Pubblicazione: (2026)
• Jenga: Effective Memory Management for Serving LLM with Heterogeneity
  di: Zhang, Chen, et al.
  Pubblicazione: (2025)
• MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
  di: Hu, Cunchen, et al.
  Pubblicazione: (2024)