LoCo: Low-Bit Communication Adaptor for Large-scale Model Training

Documenti analoghi

• Optimization Hyper-parameter Laws for Large Language Models
  di: Xie, Xingyu, et al.
  Pubblicazione: (2024)
• On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem
  di: Ding, Kuangyu, et al.
  Pubblicazione: (2025)
• Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning
  di: Ding, Kuangyu, et al.
  Pubblicazione: (2023)
• Learning Graph Laplacian with MCP
  di: Zhang, Yangjing, et al.
  Pubblicazione: (2020)
• Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  di: Xie, Xingyu, et al.
  Pubblicazione: (2022)