Optimization Hyper-parameter Laws for Large Language Models

Documenti analoghi

• On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem
  di: Ding, Kuangyu, et al.
  Pubblicazione: (2025)
• Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning
  di: Ding, Kuangyu, et al.
  Pubblicazione: (2023)
• Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization
  di: Xiao, Nachuan, et al.
  Pubblicazione: (2024)
• LoCo: Low-Bit Communication Adaptor for Large-scale Model Training
  di: Xie, Xingyu, et al.
  Pubblicazione: (2024)
• Stochastic Bregman Subgradient Methods for Nonsmooth Nonconvex Optimization Problems
  di: Ding, Kuangyu, et al.
  Pubblicazione: (2024)