Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization

Documenti analoghi

• Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
  di: Nagashima, Shuntaro, et al.
  Pubblicazione: (2026)
• Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization
  di: Sato, Naoki, et al.
  Pubblicazione: (2023)
• Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
  di: Harada, Hinata, et al.
  Pubblicazione: (2024)
• Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
  di: Tsukada, Yuki, et al.
  Pubblicazione: (2023)
• Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
  di: Liu, Zijian, et al.
  Pubblicazione: (2024)