DDiT: Dynamic Resource Allocation for Diffusion Transformer Model Serving

Documenti analoghi

• MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
  di: Hu, Cunchen, et al.
  Pubblicazione: (2024)
• Inference without Interference: Disaggregate LLM Inference for Mixed Downstream Workloads
  di: Hu, Cunchen, et al.
  Pubblicazione: (2024)
• GoodServe: Towards High-Goodput Serving of Agentic LLM Inferences over Heterogeneous Resources
  di: Du, Boxiao, et al.
  Pubblicazione: (2026)
• CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
  di: Li, Suyi, et al.
  Pubblicazione: (2024)
• Adaptive Resource Allocation for Workflow Containerization on Kubernetes
  di: Shan, Chenggang, et al.
  Pubblicazione: (2023)