Cover Image

Injectivity of ReLU networks: perspectives from statistical physics

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Maillard, Antoine, Bandeira, Afonso S., Belius, David, Dokmanić, Ivan, Nakajima, Shuta
Format:	Preprint
Published:	2023
Subjects:	Disordered Systems and Neural Networks Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Injectivity capacity of ReLU gates
by: Stojnic, Mihailo
Published: (2024)

Exact threshold for approximate ellipsoid fitting of random points
by: Bandeira, Afonso S., et al.
Published: (2023)

Average-case matrix discrepancy: satisfiability bounds
by: Maillard, Antoine
Published: (2024)

Deep ReLU networks -- injectivity capacity upper bounds
by: Stojnic, Mihailo
Published: (2024)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
by: Maillard, Antoine, et al.
Published: (2024)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)

Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications
by: Xu, Yizhou, et al.
Published: (2025)

Continuous Specialization Transition in the Soft Committee Machine with ReLU Activation
by: Afanah, Assem, et al.
Published: (2026)

Homophily modulates double descent generalization in graph convolution networks
by: Shi, Cheng, et al.
Published: (2022)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)

Spring-block theory of feature learning in deep neural networks
by: Shi, Cheng, et al.
Published: (2024)

Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
by: Annesi, Brandon L., et al.
Published: (2024)

A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights
by: Ricci, Fabiola, et al.
Published: (2026)

Topological Exploration of High-Dimensional Empirical Risk Landscapes: general approach, and applications to phase retrieval
by: Maillard, Antoine, et al.
Published: (2026)

Rigorous Asymptotics for First-Order Algorithms Through the Dynamical Cavity Method
by: Dandi, Yatin, et al.
Published: (2026)

Fitting an ellipsoid to random points: predictions using the replica method
by: Maillard, Antoine, et al.
Published: (2023)

Memorisation, convergence and generalisation in generative models
by: Maillard, Antoine, et al.
Published: (2026)

Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
by: Albergo, Michael S., et al.
Published: (2023)

The twin peaks of learning neural networks
by: Demyanenko, Elizaveta, et al.
Published: (2024)

Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens
by: Erba, Vittorio, et al.
Published: (2024)

The committee machine: Computational to statistical gaps in learning a two-layers neural network
by: Aubin, Benjamin, et al.
Published: (2018)

Capacity of the Hebbian-Hopfield network associative memory
by: Stojnic, Mihailo
Published: (2024)

Fixed width treelike neural networks capacity analysis -- generic activations
by: Stojnic, Mihailo
Published: (2024)

Generalization performance of narrow one-hidden layer networks in the teacher-student setting
by: Ortiz, Rodrigo Pérez, et al.
Published: (2025)

Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations
by: Stojnic, Mihailo
Published: (2024)

Structure of solutions to continuous constraint satisfaction problems through the statistics of wedged and inscribed spheres
by: Kent-Dobias, Jaron
Published: (2025)

Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
by: Giorlandino, Alessio, et al.
Published: (2026)

On the Atypical Solutions of the Symmetric Binary Perceptron
by: Barbier, Damien, et al.
Published: (2023)

Density Function of Weighted Sum of Chi-Square Variables with Trigonometric Weights
by: Egorov, Vladislav, et al.
Published: (2024)

Stochastic Safety Limits and Scale-Dependent Power Fluctuations in Nuclear Reactors: A Critical Scaling Approach
by: Ryazanov, V. V.
Published: (2026)

Limit theorems for Randic index for Erdős-Renyi graphs
by: Eslava, Laura, et al.
Published: (2024)

Spin Glass Concepts in Computer Science, Statistics, and Learning
by: Montanari, Andrea
Published: (2026)

Color symmetry breaking in the Potts spin glass
by: Mourrat, Jean-Christophe
Published: (2024)

Population Level Activity in Large Random Neural Networks
by: MacLaurin, James, et al.
Published: (2024)

Spin glasses and the Parisi formula
by: Mourrat, Jean-Christophe
Published: (2025)

Diffusive geodesics wandering in networks of rigid chains
by: Marquis, Ulysse
Published: (2025)

Sampling the space of solutions of an artificial neural network
by: Zambon, Alessandro, et al.
Published: (2025)

Gaussian mixtures and non-parametric likelihoods through the lens of statistical mechanics
by: Ghosh, Subhroshekhar, et al.
Published: (2026)

Deep neural networks from the perspective of ergodic theory
by: Zhang, Fan
Published: (2023)

An integrative dynamical perspective for graph theory and the study of complex networks
by: Zamora-López, Gorka, et al.
Published: (2023)