Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization

Documenti analoghi

• On the $O(\frac{\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\ell_1$ Norm
  di: Li, Huan, et al.
  Pubblicazione: (2025)
• Optimizer-Induced Mode Connectivity: From AdamW to Muon
  di: Zhang, Fangzhao, et al.
  Pubblicazione: (2026)
• HomeAdam: Adam and AdamW Algorithms Sometimes Go Home to Obtain Better Provable Generalization
  di: Huang, Feihu, et al.
  Pubblicazione: (2026)
• Convergence Rate Analysis of the AdamW-Style Shampoo: Unifying One-Sided and Two-Sided Preconditioning
  di: Li, Huan, et al.
  Pubblicazione: (2026)
• The Rich and the Simple: On the Implicit Bias of Adam and SGD
  di: Vasudeva, Bhavya, et al.
  Pubblicazione: (2025)