Convergence Rate Analysis of LION

Documenti analoghi

• Convergence Rate Analysis of the AdamW-Style Shampoo: Unifying One-Sided and Two-Sided Preconditioning
  di: Li, Huan, et al.
  Pubblicazione: (2026)
• On the $O(\frac{\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\ell_1$ Norm
  di: Li, Huan, et al.
  Pubblicazione: (2025)
• Convergence Rate Analysis of SOAP with Arbitrary Orthogonal Projection Matrices
  di: Li, Huan, et al.
  Pubblicazione: (2026)
• Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization
  di: Li, Huan, et al.
  Pubblicazione: (2021)
• On the $O(\frac{\sqrt{d}}{T^{1/4}})$ Convergence Rate of RMSProp and Its Momentum Extension Measured by $\ell_1$ Norm
  di: Li, Huan, et al.
  Pubblicazione: (2024)