SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms

Documenti analoghi

• AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
  di: Ostroukhov, Petr, et al.
  Pubblicazione: (2024)
• Newton Method Revisited: Global Convergence Rates up to $\mathcal {O}\left(k^{-3} \right)$ for Stepsize Schedules and Linesearch Procedures
  di: Hanzely, Slavomír, et al.
  Pubblicazione: (2024)
• Polyak Stepsize: Estimating Optimal Functional Values Without Parameters or Prior Knowledge
  di: Abdukhakimov, Farshed, et al.
  Pubblicazione: (2025)
• $ψ$DAG: Projected Stochastic Approximation Iteration for DAG Structure Learning
  di: Ziu, Klea, et al.
  Pubblicazione: (2024)
• Stochastic Gradient Methods with Preconditioned Updates
  di: Sadiev, Abdurakhmon, et al.
  Pubblicazione: (2022)