Copertina

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for Kolmogorov partial differential equations with Lipschitz nonlinearities in the $L^p$-sense

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ackermann, Julia, Jentzen, Arnulf, Kruse, Thomas, Kuckuck, Benno, Padgett, Joshua Lee
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Numerical Analysis Machine Learning Probability 65M15, 65C05, 68T07 (Primary) 60H35 (Secondary)
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations
di: Ackermann, Julia, et al.
Pubblicazione: (2024)

An extrapolated and provably convergent algorithm for nonlinear matrix decomposition with the ReLU function
di: Gillis, Nicolas, et al.
Pubblicazione: (2025)

Multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation overcome the curse of dimensionality when approximating semilinear parabolic partial differential equations in $L^p$-sense
di: Neufeld, Ariel, et al.
Pubblicazione: (2024)

Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activation
di: Do, Thang, et al.
Pubblicazione: (2024)

On the growth of the parameters of approximating ReLU neural networks
di: Morina, Erion, et al.
Pubblicazione: (2024)

Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation
di: Li, Li'ang, et al.
Pubblicazione: (2023)

On the algorithmic construction of deep ReLU networks
di: Huybrechs, Daan
Pubblicazione: (2025)

Deep neural networks can provably solve Bellman equations for Markov decision processes without the curse of dimensionality
di: Jentzen, Arnulf, et al.
Pubblicazione: (2025)

A Structure-Guided Gauss-Newton Method for Shallow ReLU Neural Network
di: Cai, Zhiqiang, et al.
Pubblicazione: (2024)

Gradient descent provably escapes saddle points in the training of shallow ReLU networks
di: Cheridito, Patrick, et al.
Pubblicazione: (2022)

Equidistribution-based training of Free Knot Splines and ReLU Neural Networks
di: Appella, Simone, et al.
Pubblicazione: (2024)

Error analysis for empirical risk minimization over clipped ReLU networks in solving linear Kolmogorov partial differential equations
di: Xiao, Jichang, et al.
Pubblicazione: (2023)

Topological obstruction to the training of shallow ReLU neural networks
di: Nurisso, Marco, et al.
Pubblicazione: (2024)

On the existence of minimizers in shallow residual ReLU neural network optimization landscapes
di: Dereich, Steffen, et al.
Pubblicazione: (2023)

Deep ReLU neural networks overcome the curse of dimensionality when approximating semilinear partial integro-differential equations
di: Neufeld, Ariel, et al.
Pubblicazione: (2023)

Exponential Expressivity of ReLU$^k$ Neural Networks on Gevrey Classes with Point Singularities
di: Opschoor, Joost A. A., et al.
Pubblicazione: (2024)

On bounds for norms of reparameterized ReLU artificial neural network parameters: sums of fractional powers of the Lipschitz norm control the network parameter vector
di: Jentzen, Arnulf, et al.
Pubblicazione: (2022)

Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities
di: Nurisso, Marco, et al.
Pubblicazione: (2026)

Convergence to good non-optimal critical points in the training of neural networks: Gradient descent optimization with one random initialization overcomes all bad non-global local minima with high probability
di: Ibragimov, Shokhrukh, et al.
Pubblicazione: (2022)

On Bounds for Norms of Reparameterized ReLU Artificial Neural Network Parameters: Sums of Fractional Powers of the Lipschitz Norm Control the Network Parameter Vector
di: Arnulf Jentzen, et al.
Pubblicazione: (2025)

Sharp Lower Bounds on Interpolation by Deep ReLU Neural Networks at Irregularly Spaced Data
di: Siegel, Jonathan W.
Pubblicazione: (2023)

Deep ReLU networks and high-order finite element methods II: Chebyshev emulation
di: Opschoor, Joost A. A., et al.
Pubblicazione: (2023)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
di: Manik, Md Motaleb Hossen, et al.
Pubblicazione: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2025)

The Resurrection of the ReLU
di: Horuz, Coşku Can, et al.
Pubblicazione: (2025)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
di: Qiu, Qi, et al.
Pubblicazione: (2024)

Randomized LU-Householder CholeskyQR
di: Guan, Haoran, et al.
Pubblicazione: (2024)

Benign overfitting in leaky ReLU networks with moderate input dimension
di: Karhadkar, Kedar, et al.
Pubblicazione: (2024)

Discrete Functional Geometry of ReLU Networks via ReLU Transition Graphs
di: Dhayalkar, Sahil Rajesh
Pubblicazione: (2025)

Constraining the outputs of ReLU neural networks
di: Alexandr, Yulia, et al.
Pubblicazione: (2025)

Toric geometry of ReLU neural networks
di: Fu, Yaoying
Pubblicazione: (2025)

Is ReLU Adversarially Robust?
di: Sooksatra, Korn, et al.
Pubblicazione: (2024)

Recursive sparse LU decomposition based on nested dissection and low rank approximations
di: Xuanru, Zhu, et al.
Pubblicazione: (2024)

Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networks
di: Do, Thang, et al.
Pubblicazione: (2025)

MIQCQP reformulation of the ReLU neural networks Lipschitz constant estimation problem
di: Sbihi, Mohammed, et al.
Pubblicazione: (2024)

Multilevel Picard approximations overcome the curse of dimensionality when approximating semilinear heat equations with gradient-dependent nonlinearities in $L^p$-sense
di: Nguyen, Tuan Anh
Pubblicazione: (2024)

Discontinuous hybrid neural networks for the one-dimensional partial differential equations
di: Wang, Xiaoyu, et al.
Pubblicazione: (2025)

Functional dimension of feedforward ReLU neural networks
di: Grigsby, J. Elisenda, et al.
Pubblicazione: (2022)

Stably unactivated neurons in ReLU neural networks
di: Brownlowe, Natalie, et al.
Pubblicazione: (2024)

Injectivity capacity of ReLU gates
di: Stojnic, Mihailo
Pubblicazione: (2024)