Adaptive Momentum and Nonlinear Damping for Neural Network Training

Documenti analoghi

• Adaptive Stepsizing for Stochastic Gradient Langevin Dynamics in Bayesian Neural Networks
  di: Rajpal, Rajit, et al.
  Pubblicazione: (2025)
• Neighbor-Sampling Based Momentum Stochastic Methods for Training Graph Neural Networks
  di: Noel, Molly, et al.
  Pubblicazione: (2025)
• Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact Subproblem Solver for Training Structured Neural Network
  di: Huang, Zih-Syuan, et al.
  Pubblicazione: (2024)
• Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks
  di: Papazov, Hristo, et al.
  Pubblicazione: (2024)
• Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
  di: Liao, Fangshuo, et al.
  Pubblicazione: (2023)