Adaptive Batch Size and Learning Rate Scheduler for Stochastic Gradient Descent Based on Minimization of Stochastic First-order Oracle Complexity

Documenti analoghi

• Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
  di: Umeda, Hikaru, et al.
  Pubblicazione: (2024)
• Optimal Growth Schedules for Batch Size and Learning Rate in SGD that Reduce SFO Complexity
  di: Umeda, Hikaru, et al.
  Pubblicazione: (2025)
• Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
  di: Oowada, Kanata, et al.
  Pubblicazione: (2025)
• Relationship between Batch Size and Number of Steps Needed for Nonconvex Optimization of Stochastic Gradient Descent using Armijo Line Search
  di: Tsukada, Yuki, et al.
  Pubblicazione: (2023)
• Momentum Does Not Reduce Stochastic Noise in Stochastic Gradient Descent
  di: Sato, Naoki, et al.
  Pubblicazione: (2024)