Cover Image

On the existence of optimal shallow feedforward networks with ReLU activation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dereich, Steffen, Kassing, Sebastian
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Numerical Analysis Optimization and Control Primary 68T07, Secondary 68T05, 41A50
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the existence of minimizers in shallow residual ReLU neural network optimization landscapes
by: Dereich, Steffen, et al.
Published: (2023)

Discretization Error of Fourier Neural Operators
by: Lanthaler, Samuel, et al.
Published: (2024)

Equidistribution-based training of Free Knot Splines and ReLU Neural Networks
by: Appella, Simone, et al.
Published: (2024)

ReLU neural network approximation to piecewise constant functions
by: Cai, Zhiqiang, et al.
Published: (2024)

On the algorithmic construction of deep ReLU networks
by: Huybrechs, Daan
Published: (2025)

Exact Loop Controllers for ReLU Realization of Homogeneous Curve Refinements
by: Bolorkhuu, Boldsaikhan, et al.
Published: (2026)

Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation
by: Li, Li'ang, et al.
Published: (2023)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations
by: Ackermann, Julia, et al.
Published: (2024)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for Kolmogorov partial differential equations with Lipschitz nonlinearities in the $L^p$-sense
by: Ackermann, Julia, et al.
Published: (2023)

Fourier Residual Networks Achieve Spectral Accuracy for Discontinuous Functions
by: Davis, Owen, et al.
Published: (2026)

Adaptive Randomized Neural Networks with Locally Activation Function: Theory and Algorithm for Solving PDEs
by: Bi, Ran, et al.
Published: (2026)

SAD Neural Networks: Divergent Gradient Flows and Asymptotic Optimality via o-minimal Structures
by: Kranz, Julian, et al.
Published: (2025)

Near-optimal learning of Banach-valued, high-dimensional functions via deep neural networks
by: Adcock, Ben, et al.
Published: (2022)

Exact ReLU realization of tensor-product refinement iterates
by: Gantumur, Tsogtgerel
Published: (2026)

Approximation bounds for norm constrained deep neural networks
by: Maiale, Francesco Paolo, et al.
Published: (2025)

Asymptotic stability properties and a priori bounds for Adam and other gradient descent optimization methods
by: Dereich, Steffen, et al.
Published: (2025)

An adaptive adjoint-oriented neural network for solving parametric optimal control problems with singularities
by: Yuan, Zikang, et al.
Published: (2025)

A Class of Random-Kernel Network Models
by: Tian, James
Published: (2025)

Approximation of the Basset force in the Maxey-Riley-Gatignol equations via universal differential equations
by: Sommer, Finn, et al.
Published: (2026)

Bridging the Gap Between Approximation and Learning via Optimal Approximation by ReLU MLPs of Maximal Regularity
by: Hong, Ruiyang, et al.
Published: (2024)

Interpolation and inverse problems in spectral Barron spaces
by: Lu, Shuai, et al.
Published: (2025)

Topological obstruction to the training of shallow ReLU neural networks
by: Nurisso, Marco, et al.
Published: (2024)

Bayesian optimization approach for tracking the location and orientation of a moving target using far-field data
by: Lee, Woojoo, et al.
Published: (2024)

Bridging the Language Gap: Enhancing Multilingual Prompt-Based Code Generation in LLMs via Zero-Shot Cross-Lingual Transfer
by: Li, Mingda, et al.
Published: (2024)

Learning Contractive Integral Operators with Fredholm Integral Neural Operators
by: Georgiou, Kyriakos C., et al.
Published: (2026)

On the Principles of ReLU Networks with One Hidden Layer
by: Huang, Changcun
Published: (2024)

Reduced Order Modeling of Partial Differential Equations on Parameter-Dependent Domains Using Deep Neural Networks
by: Bukač, Martina, et al.
Published: (2024)

Trustworthy AI in numerics: On verification algorithms for neural network-based PDE solvers
by: Haugen, Emil, et al.
Published: (2025)

Sample-based almost-sure quasi-optimal approximation in reproducing kernel Hilbert spaces
by: Hegemann, Nando, et al.
Published: (2024)

Deep ReLU networks and high-order finite element methods II: Chebyshev emulation
by: Opschoor, Joost A. A., et al.
Published: (2023)

Approximation Error and Complexity Bounds for ReLU Networks on Low-Regular Function Spaces
by: Davis, Owen, et al.
Published: (2024)

Probability error bounds for approximation of functions in reproducing kernel Hilbert spaces
by: Aydin, Ata Deniz, et al.
Published: (2020)

Time-Frequency Analysis for Neural Networks
by: Abdeljawad, Ahmed, et al.
Published: (2025)

Neural Preconditioned Born Series: A Metric-Matched Framework for Learning-based Preconditioners
by: Wang, Juntao, et al.
Published: (2026)

Derivative-Informed Fourier Neural Operator: Universal Approximation and Applications to PDE-Constrained Optimization
by: Yao, Boyuan, et al.
Published: (2025)

InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
by: Zhang, Tony, et al.
Published: (2025)

HYCO: A Formalism for Hybrid-Cooperative PDE Modelling
by: Liverani, Lorenzo, et al.
Published: (2026)

Exact Sequence Interpolation with Transformers
by: Alcalde, Albert, et al.
Published: (2025)

Learning to Control: The iUzawa-Net for Nonsmooth Optimal Control of Linear PDEs
by: Song, Yongcun, et al.
Published: (2026)

Constructive Universal Approximation and Finite Sample Memorization by Narrow Deep ReLU Networks
by: Hernández, Martín, et al.
Published: (2024)