Cover Image

Large Deviations of Gaussian Neural Networks with ReLU activation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Vogel, Quirin
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Probability 60F10, 68T07
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Functional Large Deviations for Wide Deep Neural Networks with Gaussian Initialization and Lipschitz Activations
by: Macci, Claudio, et al.
Published: (2026)

Large and moderate deviations for Gaussian neural networks
by: Macci, Claudio, et al.
Published: (2024)

Posterior Bayesian Neural Networks with Dependent Weights
by: Apollonio, Nicola, et al.
Published: (2025)

Large deviations of one-hidden-layer neural networks
by: Hirsch, Christian, et al.
Published: (2024)

Near-optimal estimates for the $\ell^p$-Lipschitz constants of deep random ReLU neural networks
by: Dirksen, Sjoerd, et al.
Published: (2025)

Phase Transitions in the Fluctuations of Functionals of Random Neural Networks
by: Di Lillo, Simmaco, et al.
Published: (2026)

Quantitative bounds for large deviations of heavy tailed random variables
by: Vogel, Quirin
Published: (2022)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for space-time solutions of semilinear partial differential equations
by: Ackermann, Julia, et al.
Published: (2024)

Non-convergence to global minimizers in data driven supervised deep learning: Adam and stochastic gradient descent optimization provably fail to converge to global minimizers in the training of deep neural networks with ReLU activation
by: Do, Thang, et al.
Published: (2024)

Fractal and Regular Geometry of Deep Neural Networks
by: Di Lillo, Simmaco, et al.
Published: (2025)

Deep neural networks with ReLU, leaky ReLU, and softplus activation provably overcome the curse of dimensionality for Kolmogorov partial differential equations with Lipschitz nonlinearities in the $L^p$-sense
by: Ackermann, Julia, et al.
Published: (2023)

Large deviation principles and functional limit theorems in the deep limit of wide random neural networks
by: Di Lillo, Simmaco, et al.
Published: (2026)

Large Spikes in Stochastic Gradient Descent: A Large-Deviations View
by: Gess, Benjamin, et al.
Published: (2026)

Optimal Non-Asymptotic Edgeworth Expansions for Multivariate Neural Network Outputs
by: Celli, Lucia
Published: (2026)

LDP for the covariance process in fully connected neural networks
by: Andreis, Luisa, et al.
Published: (2025)

Large deviations for light-tailed Lévy bridges on short time scales
by: Högele, Michael A., et al.
Published: (2025)

Separation capacity of linear reservoirs with random connectivity matrix
by: Boutaib, Youness
Published: (2024)

On large deviations for the range of a two-dimensional random walk
by: Popov, Serguei, et al.
Published: (2026)

On the Rashomon ratio of infinite hypothesis sets
by: Coupkova, Evzenie, et al.
Published: (2024)

Kernel Limit for a Class of Recurrent Neural Networks Trained on Ergodic Data Sequences
by: Lam, Samuel Chun-Hei, et al.
Published: (2023)

Convergence Analysis of Real-time Recurrent Learning (RTRL) for a class of Recurrent Neural Networks
by: Lam, Samuel Chun-Hei, et al.
Published: (2025)

Regime-Aware Conditional Neural Processes with Multi-Criteria Decision Support for Operational Electricity Price Forecasting
by: Das, Abhinav, et al.
Published: (2025)

Genus expansion for non-linear random matrix ensembles with applications to neural networks
by: Cirone, Nicola Muca, et al.
Published: (2024)

Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility
by: Lee, Hoil, et al.
Published: (2022)

Constructive Universal Approximation and Finite Sample Memorization by Narrow Deep ReLU Networks
by: Hernández, Martín, et al.
Published: (2024)

Large deviations for a spatial average of stochastic heat and wave equations
by: Ebina, Masahisa
Published: (2024)

Is ReLU Adversarially Robust?
by: Sooksatra, Korn, et al.
Published: (2024)

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers under Fully Homomorphic Encryption on the Torus
by: Brännvall, Rickard, et al.
Published: (2023)

Entropic bounds for conditionally Gaussian vectors and applications to neural networks
by: Celli, Lucia, et al.
Published: (2025)

Identifiability and Stability of Generative Drifting with Companion-Elliptic Kernel Families
by: Lee, HakGeun, et al.
Published: (2026)

Large Deviations for Iterated Sums and Integrals
by: Kifer, Yuri, et al.
Published: (2025)

High-dimensional learning dynamics of multi-pass Stochastic Gradient Descent in multi-index models
by: Fan, Zhou, et al.
Published: (2026)

Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
by: Hashimoto, Ichiro
Published: (2025)

Equidistribution-based training of Free Knot Splines and ReLU Neural Networks
by: Appella, Simone, et al.
Published: (2024)

Mixed memories in Hopfield networks
by: Gayrard, Véronique
Published: (2025)

On the existence of optimal shallow feedforward networks with ReLU activation
by: Dereich, Steffen, et al.
Published: (2023)

Sample-Path Large Deviations for Lévy Processes and Random Walks with Lognormal Increments
by: Su, Zhe, et al.
Published: (2024)

Erzeugunsgrad, VC-Dimension and Neural Networks with rational activation function
by: Pardo, Luis Miguel, et al.
Published: (2025)

Iterative Methods for Full-Scale Gaussian Process Approximations for Large Spatial Data
by: Gyger, Tim, et al.
Published: (2024)

Signature Reconstruction from Randomized Signatures
by: Glückstad, Mie, et al.
Published: (2025)