QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices

Documenti analoghi

• LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization
  di: Zhao, Juntao, et al.
  Pubblicazione: (2024)
• Laminar: A Scalable Asynchronous RL Post-Training Framework
  di: Sheng, Guangming, et al.
  Pubblicazione: (2025)
• HybridFlow: A Flexible and Efficient RLHF Framework
  di: Sheng, Guangming, et al.
  Pubblicazione: (2024)
• MegaScale-Data: Scaling Dataloader for Multisource Large Foundation Model Training
  di: Zhao, Juntao, et al.
  Pubblicazione: (2025)
• Empowering Distributed Training with Sparsity-driven Data Synchronization
  di: Wang, Zhuang, et al.
  Pubblicazione: (2023)