Convergence of SGD with momentum in the nonconvex case: A time window-based analysis

Documenti analoghi

• A KL-based Analysis Framework with Applications to Non-Descent Optimization Methods
  di: Qiu, Junwen, et al.
  Pubblicazione: (2024)
• Random Reshuffling with Momentum for Nonconvex Problems: Iteration Complexity and Last Iterate Convergence
  di: Qiu, Junwen, et al.
  Pubblicazione: (2024)
• A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Properties
  di: Qiu, Junwen, et al.
  Pubblicazione: (2023)
• A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimization
  di: Qiu, Junwen, et al.
  Pubblicazione: (2023)
• General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization
  di: Ahn, Kwangjun, et al.
  Pubblicazione: (2024)