Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism

Documenti analoghi

• DawnPiper: A Memory-scablable Pipeline Parallel Training Framework
  di: Peng, Xuan, et al.
  Pubblicazione: (2025)
• Memory Efficient and Staleness Free Pipeline Parallel DNN Training Framework with Improved Convergence Speed
  di: Dutta, Ankita, et al.
  Pubblicazione: (2025)
• Balancing Pipeline Parallelism with Vocabulary Parallelism
  di: Yeung, Man Tsung, et al.
  Pubblicazione: (2024)
• Adaptra: Straggler-Resilient Hybrid-Parallel Training with Pipeline Adaptation
  di: Wu, Tianyuan, et al.
  Pubblicazione: (2025)
• Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
  di: Sun, Ao, et al.
  Pubblicazione: (2024)