Cover Image

Stably unactivated neurons in ReLU neural networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Brownlowe, Natalie, Cornwell, Christopher R., Montes, Ethan, Quijano, Gabriel, Stulman, Grace, Zhang, Na
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multilevel Picard approximations and deep neural networks with ReLU, leaky ReLU, and softplus activation overcome the curse of dimensionality when approximating semilinear parabolic partial differential equations in $L^p$-sense
by: Neufeld, Ariel, et al.
Published: (2024)

Random ReLU Neural Networks as Non-Gaussian Processes
by: Parhi, Rahul, et al.
Published: (2024)

Injectivity of ReLU networks: perspectives from statistical physics
by: Maillard, Antoine, et al.
Published: (2023)

Depth Degeneracy in Neural Networks: Vanishing Angles in Fully Connected ReLU Networks on Initialization
by: Jakub, Cameron, et al.
Published: (2023)

Non-asymptotic convergence analysis of the stochastic gradient Hamiltonian Monte Carlo algorithm with discontinuous stochastic gradient with applications to training of ReLU neural networks
by: Liang, Luxu, et al.
Published: (2024)

Uncertainty Quantification with Bayesian Higher Order ReLU KANs
by: Giroux, James, et al.
Published: (2024)

Large Deviations of Gaussian Neural Networks with ReLU activation
by: Vogel, Quirin
Published: (2024)

Constraining the outputs of ReLU neural networks
by: Alexandr, Yulia, et al.
Published: (2025)

Toric geometry of ReLU neural networks
by: Fu, Yaoying
Published: (2025)

Optimal Initialization in Depth: Lyapunov Initialization and Limit Theorems for Deep Leaky ReLU Networks
by: Kogler, Constantin, et al.
Published: (2026)

Near-optimal estimates for the $\ell^p$-Lipschitz constants of deep random ReLU neural networks
by: Dirksen, Sjoerd, et al.
Published: (2025)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations
by: Ackermann, Julia, et al.
Published: (2024)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for Kolmogorov partial differential equations with Lipschitz nonlinearities in the $L^p$-sense
by: Ackermann, Julia, et al.
Published: (2023)

An analysis of optimization problems involving ReLU neural networks
by: Plate, Christoph, et al.
Published: (2025)

On the growth of the parameters of approximating ReLU neural networks
by: Morina, Erion, et al.
Published: (2024)

Two-hidden-layer ReLU neural networks and finite elements
by: Jin, Pengzhan
Published: (2024)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
by: Manik, Md Motaleb Hossen, et al.
Published: (2025)

Functional dimension of feedforward ReLU neural networks
by: Grigsby, J. Elisenda, et al.
Published: (2022)

MIQCQP reformulation of the ReLU neural networks Lipschitz constant estimation problem
by: Sbihi, Mohammed, et al.
Published: (2024)

Nonparametric regression using over-parameterized shallow ReLU neural networks
by: Yang, Yunfei, et al.
Published: (2023)

Memorization capacity of deep ReLU neural networks characterized by width and depth
by: Yang, Xin, et al.
Published: (2026)

Discrete Functional Geometry of ReLU Networks via ReLU Transition Graphs
by: Dhayalkar, Sahil Rajesh
Published: (2025)

The Resurrection of the ReLU
by: Horuz, Coşku Can, et al.
Published: (2025)

Optimal rates of approximation by shallow ReLU$^k$ neural networks and applications to nonparametric regression
by: Yang, Yunfei, et al.
Published: (2023)

The Geometry of ReLU Networks through the ReLU Transition Graph
by: Dhayalkar, Sahil Rajesh
Published: (2025)

On the optimal approximation of Sobolev and Besov functions using deep ReLU neural networks
by: Yang, Yunfei
Published: (2024)

Path-conditioned training: a principled way to rescale ReLU neural networks
by: Lebeurrier, Arthur, et al.
Published: (2026)

Approximation and learning of anisotropic and mixed smooth functions by deep ReLU neural networks
by: Yang, Yunfei, et al.
Published: (2026)

ReLU neural network approximation to piecewise constant functions
by: Cai, Zhiqiang, et al.
Published: (2024)

The minimal width of universal $p$-adic ReLU neural networks
by: Kiss, Sándor Z., et al.
Published: (2026)

Topological obstruction to the training of shallow ReLU neural networks
by: Nurisso, Marco, et al.
Published: (2024)

Nonlocal techniques for the analysis of deep ReLU neural network approximations
by: Schneider, Cornelia, et al.
Published: (2025)

Benign overfitting in leaky ReLU networks with moderate input dimension
by: Karhadkar, Kedar, et al.
Published: (2024)

Generalization analysis with deep ReLU networks for metric and similarity learning
by: Zhou, Junyu, et al.
Published: (2024)

Simplicity bias and optimization threshold in two-layer ReLU networks
by: Boursier, Etienne, et al.
Published: (2024)

Weighted variation spaces and approximation by shallow ReLU networks
by: DeVore, Ronald, et al.
Published: (2023)

SurvReLU: Inherently Interpretable Survival Analysis via Deep ReLU Networks
by: Sun, Xiaotong, et al.
Published: (2024)

On the algorithmic construction of deep ReLU networks
by: Huybrechs, Daan
Published: (2025)

Deep ReLU neural networks overcome the curse of dimensionality when approximating semilinear partial integro-differential equations
by: Neufeld, Ariel, et al.
Published: (2023)

Symmetric Matrix Completion with ReLU Sampling
by: Liu, Huikang, et al.
Published: (2024)