Incremental Gradient Descent with Small Epoch Counts is Surprisingly Slow on Ill-Conditioned Problems

Documenti analoghi

• Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
  di: Jung, Hyunji, et al.
  Pubblicazione: (2025)
• Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
  di: Phunyaphibarn, Prin, et al.
  Pubblicazione: (2023)
• Stochastic Extragradient with Flip-Flop Shuffling & Anchoring: Provable Improvements
  di: Chae, Jiseok, et al.
  Pubblicazione: (2024)
• Adaptive Conditional Gradient Descent
  di: Khademi, Abbas, et al.
  Pubblicazione: (2025)
• Fundamental Benefit of Alternating Updates in Minimax Optimization
  di: Lee, Jaewook, et al.
  Pubblicazione: (2024)