LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism

Documenti analoghi

• Fast Distributed Inference Serving for Large Language Models
  di: Wu, Bingyang, et al.
  Pubblicazione: (2023)
• TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving
  di: Wu, Bingyang, et al.
  Pubblicazione: (2025)
• DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
  di: Zhong, Yinmin, et al.
  Pubblicazione: (2024)
• LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
  di: Gu, Diandian, et al.
  Pubblicazione: (2024)
• Optimizing Long-context LLM Serving via Fine-grained Sequence Parallelism
  di: Li, Cong, et al.
  Pubblicazione: (2025)