UELLM: A Unified and Efficient Approach for LLM Inference Serving

Documenti analoghi

• Cloud Native System for LLM Inference Serving
  di: Xu, Minxian, et al.
  Pubblicazione: (2025)
• Unlock the Potential of Fine-grained LLM Serving via Dynamic Module Scaling
  di: Wu, Jingfeng, et al.
  Pubblicazione: (2025)
• BucketServe: Bucket-Based Dynamic Batching for Smart and Efficient LLM Inference Serving
  di: Zheng, Wanyi, et al.
  Pubblicazione: (2025)
• CloudNativeSim: a toolkit for modeling and simulation of cloud-native applications
  di: Wu, Jingfeng, et al.
  Pubblicazione: (2024)
• DOPD: A Dynamic PD-Disaggregation Architecture for Maximizing Goodput in LLM Inference Serving
  di: Liao, Junhan, et al.
  Pubblicazione: (2025)