FlexPipe: Adapting Dynamic LLM Serving Through Inflight Pipeline Refactoring in Fragmented Serverless Clusters

Documenti analoghi

• FASER: Fine-Grained Phase Management for Speculative Decoding in Dynamic LLM Serving
  di: Chen, Wenyan, et al.
  Pubblicazione: (2026)
• Unlock the Potential of Fine-grained LLM Serving via Dynamic Module Scaling
  di: Wu, Jingfeng, et al.
  Pubblicazione: (2025)
• BrownoutServe: SLO-Aware Inference Serving under Bursty Workloads for MoE-based LLMs
  di: Hu, Jianmin, et al.
  Pubblicazione: (2025)
• Cloud Native System for LLM Inference Serving
  di: Xu, Minxian, et al.
  Pubblicazione: (2025)
• UELLM: A Unified and Efficient Approach for LLM Inference Serving
  di: He, Yiyuan, et al.
  Pubblicazione: (2024)