Muon Converges under Heavy-Tailed Noise: Nonconvex Hölder-Smooth Empirical Risk Minimization

Ejemplares similares

• Improved Convergence Rates of Muon Optimizer for Nonconvex Optimization
  por: Nagashima, Shuntaro, et al.
  Publicado: (2026)
• Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization
  por: Sato, Naoki, et al.
  Publicado: (2023)
• Convergence of Sharpness-Aware Minimization Algorithms using Increasing Batch Size and Decaying Learning Rate
  por: Harada, Hinata, et al.
  Publicado: (2024)
• Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
  por: Tsukada, Yuki, et al.
  Publicado: (2023)
• Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
  por: Liu, Zijian, et al.
  Publicado: (2024)