PacTrain: Pruning and Adaptive Sparse Gradient Compression for Efficient Collective Communication in Distributed Deep Learning

Documenti analoghi

• NetSenseML: Network-Adaptive Compression for Efficient Distributed Machine Learning
  di: Wang, Yisu, et al.
  Pubblicazione: (2025)
• Rethinking Dynamic Networks and Heterogeneous Computing with Automatic Parallelization
  di: Wu, Ruilong, et al.
  Pubblicazione: (2025)
• Byzantine-Robust and Communication-Efficient Distributed Training: Compressive and Cyclic Gradient Coding
  di: Li, Chengxi, et al.
  Pubblicazione: (2026)
• Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient
  di: Deng, Xiaoge, et al.
  Pubblicazione: (2021)
• Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey
  di: Liang, Feng, et al.
  Pubblicazione: (2024)