Saved in:
| Main Authors: | Ibragimov, Shokhrukh, Jentzen, Arnulf, Riekert, Adrian |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2212.13111 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networks
by: Do, Thang, et al.
Published: (2025)
by: Do, Thang, et al.
Published: (2025)
Asymptotic stability properties and a priori bounds for Adam and other gradient descent optimization methods
by: Dereich, Steffen, et al.
Published: (2025)
by: Dereich, Steffen, et al.
Published: (2025)
Sharp higher order convergence rates for the Adam optimizer
by: Dereich, Steffen, et al.
Published: (2025)
by: Dereich, Steffen, et al.
Published: (2025)
Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates
by: Dereich, Steffen, et al.
Published: (2024)
by: Dereich, Steffen, et al.
Published: (2024)
Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activation
by: Do, Thang, et al.
Published: (2024)
by: Do, Thang, et al.
Published: (2024)
Uniform a priori bounds and error analysis for the Adam stochastic gradient descent optimization method
by: Dereich, Steffen, et al.
Published: (2026)
by: Dereich, Steffen, et al.
Published: (2026)
Non-convergence to global minimizers for Adam and stochastic gradient descent optimization and constructions of local minimizers in the training of artificial neural networks
by: Jentzen, Arnulf, et al.
Published: (2024)
by: Jentzen, Arnulf, et al.
Published: (2024)
Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations
by: Ackermann, Julia, et al.
Published: (2024)
by: Ackermann, Julia, et al.
Published: (2024)
Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing
by: Becker, Sebastian, et al.
Published: (2022)
by: Becker, Sebastian, et al.
Published: (2022)
Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for Kolmogorov partial differential equations with Lipschitz nonlinearities in the $L^p$-sense
by: Ackermann, Julia, et al.
Published: (2023)
by: Ackermann, Julia, et al.
Published: (2023)
Averaged Adam accelerates stochastic optimization in the training of deep neural network approximations for partial differential equation and optimal control problems
by: Dereich, Steffen, et al.
Published: (2025)
by: Dereich, Steffen, et al.
Published: (2025)
Adam symmetry theorem: characterization of the convergence of the stochastic Adam optimizer
by: Dereich, Steffen, et al.
Published: (2025)
by: Dereich, Steffen, et al.
Published: (2025)
Introduction: Swarm-based gradient descent for non convex optimization
by: Tikko, Janina
Published: (2024)
by: Tikko, Janina
Published: (2024)
Subspace-constrained randomized coordinate descent for linear systems with good low-rank matrix approximations
by: Lok, Jackie, et al.
Published: (2025)
by: Lok, Jackie, et al.
Published: (2025)
Accelerating non-local exchange in generalized optimized Schwarz methods
by: Atchekzai, Roxane, et al.
Published: (2024)
by: Atchekzai, Roxane, et al.
Published: (2024)
Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses
by: Dereich, Steffen, et al.
Published: (2024)
by: Dereich, Steffen, et al.
Published: (2024)
Convergence of the non-staggered Nessyahu-Tadmor scheme for coupled systems of one-dimensional nonlocal balance laws
by: Sudha, Sanjibanee, et al.
Published: (2025)
by: Sudha, Sanjibanee, et al.
Published: (2025)
Small errors in random zeroth-order optimization are imaginary
by: Jongeneel, Wouter, et al.
Published: (2021)
by: Jongeneel, Wouter, et al.
Published: (2021)
On the logical skills of large language models: evaluations using arbitrarily complex first-order logic problems
by: Ibragimov, Shokhrukh, et al.
Published: (2025)
by: Ibragimov, Shokhrukh, et al.
Published: (2025)
Weak convergence rates for temporal numerical approximations of stochastic wave equations with multiplicative noise
by: Cox, Sonja, et al.
Published: (2019)
by: Cox, Sonja, et al.
Published: (2019)
Swarm-based optimization with random descent
by: Tadmor, Eitan, et al.
Published: (2023)
by: Tadmor, Eitan, et al.
Published: (2023)
An explicit construction of optimized interpolation points on the 4-simplex
by: Gobel, Trenton J., et al.
Published: (2024)
by: Gobel, Trenton J., et al.
Published: (2024)
Convergence and stability of randomized implicit two-stage Runge-Kutta schemes
by: Bochacik, Tomasz, et al.
Published: (2024)
by: Bochacik, Tomasz, et al.
Published: (2024)
Accelerated optimization algorithms and ordinary differential equations: the convex non Euclidean case
by: Dobson, Paul, et al.
Published: (2024)
by: Dobson, Paul, et al.
Published: (2024)
Deep neural networks can provably solve Bellman equations for Markov decision processes without the curse of dimensionality
by: Jentzen, Arnulf, et al.
Published: (2025)
by: Jentzen, Arnulf, et al.
Published: (2025)
Mixed finite element approximation for non-divergence form elliptic equations with random input data
by: Mousavi, Amireh
Published: (2025)
by: Mousavi, Amireh
Published: (2025)
Controlled fields, rough stochastic calculus, and Itô-Wentzell-Alekseev-Gröbner identities
by: Dause, Jannis R., et al.
Published: (2026)
by: Dause, Jannis R., et al.
Published: (2026)
Convergence in probability of numerical solutions of a highly non-linear delayed stochastic interest rate model
by: Coffie, Emmanuel
Published: (2025)
by: Coffie, Emmanuel
Published: (2025)
Convergence analysis for non-iterative sequential schemes for Biot's model
by: Hu, Xiaozhe, et al.
Published: (2025)
by: Hu, Xiaozhe, et al.
Published: (2025)
Localization of tumor through a non-conventional numerical shape optimization technique
by: Rabago, Julius Fergy Tiongson
Published: (2025)
by: Rabago, Julius Fergy Tiongson
Published: (2025)
Generalized preconditioned conjugate gradients for adaptive FEM with optimal complexity
by: Hilbert, Paula, et al.
Published: (2026)
by: Hilbert, Paula, et al.
Published: (2026)
PADAM: Parallel averaged Adam reduces the error for stochastic optimization in scientific machine learning
by: Jentzen, Arnulf, et al.
Published: (2025)
by: Jentzen, Arnulf, et al.
Published: (2025)
Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems
by: Qian, Yitian, et al.
Published: (2024)
by: Qian, Yitian, et al.
Published: (2024)
Adaptive finite element methods with optimally preconditioned GMRES guarantee optimal complexity
by: Führer, Thomas, et al.
Published: (2026)
by: Führer, Thomas, et al.
Published: (2026)
Convergence rates for gradient descent in the training of overparameterized artificial neural networks with piecewise affine activation
by: Jentzen, Arnulf, et al.
Published: (2021)
by: Jentzen, Arnulf, et al.
Published: (2021)
A quasi-optimal space-time FEM with local mesh refinements for parabolic problems
by: Diening, Lars, et al.
Published: (2025)
by: Diening, Lars, et al.
Published: (2025)
Adaptive and non-adaptive randomized approximation of high-dimensional vectors
by: Kunsch, Robert J., et al.
Published: (2024)
by: Kunsch, Robert J., et al.
Published: (2024)
Preconditioned primal-dual dynamics in convex optimization: non-ergodic convergence rates
by: Apidopoulos, Vassilis, et al.
Published: (2025)
by: Apidopoulos, Vassilis, et al.
Published: (2025)
Global random walk for one-dimensional one-phase Stefan-type moving-boundary problems: Simulation results
by: Suciu, Nicolae, et al.
Published: (2024)
by: Suciu, Nicolae, et al.
Published: (2024)
Strong convergence rates for explicit space-time discrete numerical approximations of stochastic Allen-Cahn equations
by: Becker, Sebastian, et al.
Published: (2017)
by: Becker, Sebastian, et al.
Published: (2017)
Similar Items
-
Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networks
by: Do, Thang, et al.
Published: (2025) -
Asymptotic stability properties and a priori bounds for Adam and other gradient descent optimization methods
by: Dereich, Steffen, et al.
Published: (2025) -
Sharp higher order convergence rates for the Adam optimizer
by: Dereich, Steffen, et al.
Published: (2025) -
Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates
by: Dereich, Steffen, et al.
Published: (2024) -
Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activation
by: Do, Thang, et al.
Published: (2024)