Convergence rates for gradient descent in the training of overparameterized artificial neural networks with piecewise affine activation

Similar Items

• Space-time deep neural network approximations for high-dimensional partial differential equations
  by: Hornung, Fabian, et al.
  Published: (2020)
• Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses
  by: Dereich, Steffen, et al.
  Published: (2024)
• Deep learning based numerical approximation algorithms for stochastic partial differential equations
  by: Beck, Christian, et al.
  Published: (2020)
• Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activation
  by: Do, Thang, et al.
  Published: (2024)
• Averaged Adam accelerates stochastic optimization in the training of deep neural network approximations for partial differential equation and optimal control problems
  by: Dereich, Steffen, et al.
  Published: (2025)