Cover Image

Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Baldassi, Carlo, Malatesta, Enrico M., Zecchina, Riccardo
Format:	Preprint
Published:	2019
Subjects:	Disordered Systems and Neural Networks Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sampling the space of solutions of an artificial neural network
by: Zambon, Alessandro, et al.
Published: (2025)

Impact of dendritic non-linearities on the computational capabilities of neurons
by: Lauditi, Clarissa, et al.
Published: (2024)

Dynamical Learning in Deep Asymmetric Recurrent Neural Networks
by: Badalotti, Davide, et al.
Published: (2025)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)

Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
by: Annesi, Brandon L., et al.
Published: (2024)

Generative diffusion for perceptron problems: statistical physics analysis and efficient algorithms
by: Demyanenko, Elizaveta, et al.
Published: (2025)

The twin peaks of learning neural networks
by: Demyanenko, Elizaveta, et al.
Published: (2024)

Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions
by: Nishiyama, Sota, et al.
Published: (2024)

Controlled Langevin Dynamics for Sampling of Feedforward Neural Networks Trained with Minibatches
by: Zambon, Alessandro, et al.
Published: (2026)

Random Features Hopfield Networks generalize retrieval to previously unseen examples
by: Kalaj, Silvio, et al.
Published: (2024)

Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations
by: Stojnic, Mihailo
Published: (2024)

Overlap Gap and Computational Thresholds in the Square Wave Perceptron
by: Benedetti, Marco, et al.
Published: (2025)

Training neural networks with structured noise improves classification and generalization
by: Benedetti, Marco, et al.
Published: (2023)

How does training shape the Riemannian geometry of neural network representations?
by: Zavatone-Veth, Jacob A., et al.
Published: (2023)

Generalization performance of narrow one-hidden layer networks in the teacher-student setting
by: Ortiz, Rodrigo Pérez, et al.
Published: (2025)

Fixed width treelike neural networks capacity analysis -- generic activations
by: Stojnic, Mihailo
Published: (2024)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)

Emergent weight morphologies in deep neural networks
by: de Jong, Pascal, et al.
Published: (2025)

High-dimensional learning of narrow neural networks
by: Cui, Hugo
Published: (2024)

Emergence of Distortions in High-Dimensional Guided Diffusion Models
by: Ventura, Enrico, et al.
Published: (2026)

Supervised and Unsupervised protocols for hetero-associative neural networks
by: Alessandrelli, Andrea, et al.
Published: (2025)

Deep neural networks from the perspective of ergodic theory
by: Zhang, Fan
Published: (2023)

Computing frustration and near-monotonicity in deep neural networks
by: Wendin, Joel, et al.
Published: (2025)

Finite-time Lyapunov exponents of deep neural networks
by: Storm, L., et al.
Published: (2023)

Are Neural Networks Collision Resistant?
by: Benedetti, Marco, et al.
Published: (2025)

Asymptotic generalization error of a single-layer graph convolutional network
by: Duranthon, O., et al.
Published: (2024)

Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)

Boundary between noise and information applied to filtering neural network weight matrices
by: Staats, Max, et al.
Published: (2022)

Adaptive kernel predictors from feature-learning infinite limits of neural networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks
by: Takasu, Shotaro, et al.
Published: (2025)

Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block model
by: Duranthon, O., et al.
Published: (2025)

Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks
by: D'Amico, Francesco, et al.
Published: (2025)

Demolition and Reinforcement of Memories in Spin-Glass-like Neural Networks
by: Ventura, Enrico
Published: (2024)

Pruning-induced phases in fully-connected neural networks: the eumentia, the dementia, and the amentia
by: Pan, Haining, et al.
Published: (2026)

Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
by: Troiani, Emanuele, et al.
Published: (2025)

BEP: A Binary Error Propagation Algorithm for Binary Neural Networks Training
by: Colombo, Luca, et al.
Published: (2025)

Deep ReLU networks -- injectivity capacity upper bounds
by: Stojnic, Mihailo
Published: (2024)

Bias-inducing geometries: an exactly solvable data model with fairness implications
by: Mannelli, Stefano Sarao, et al.
Published: (2022)

A Random-Matrix Criterion for Initializing Gated Recurrent Neural Networks
by: Fioratti, Tommaso, et al.
Published: (2026)

Exact Learning Dynamics of In-Context Learning in Linear Transformers and Its Application to Non-Linear Transformers
by: Mainali, Nischal, et al.
Published: (2025)