Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks

Documenti analoghi

• Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
  di: Phunyaphibarn, Prin, et al.
  Pubblicazione: (2023)
• On the Trajectories of SGD Without Replacement
  di: Beneventano, Pierfrancesco
  Pubblicazione: (2023)
• Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
  di: Jung, Hyunji, et al.
  Pubblicazione: (2025)
• Edge of Stochastic Stability: Revisiting the Edge of Stability for SGD
  di: Andreyev, Arseniy, et al.
  Pubblicazione: (2024)
• How Neural Networks Learn the Support is an Implicit Regularization Effect of SGD
  di: Beneventano, Pierfrancesco, et al.
  Pubblicazione: (2024)