Cover Image

Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Annesi, Brandon Livio, Bocchi, Dario, Cammarota, Chiara
Format:	Preprint
Published:	2025
Subjects:	Disordered Systems and Neural Networks Statistical Mechanics Spectral Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Discontinuous BBP transitions
by: Bocchi, Dario, et al.
Published: (2026)

Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
by: Bocchi, Dario, et al.
Published: (2026)

The Role of the Time-Dependent Hessian in High-Dimensional Optimization
by: Bonnaire, Tony, et al.
Published: (2024)

Spectra of random graphs with discrete scale invariance
by: Catanzaro, Alessio, et al.
Published: (2025)

Eigenvalue spectral tails and localization properties of asymmetric networks
by: Valigi, Pietro, et al.
Published: (2025)

Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings
by: D'Amico, Francesco, et al.
Published: (2025)

Dynamical systems on large networks with predator-prey interactions are stable and exhibit oscillations
by: Mambuca, Andrea Marcello, et al.
Published: (2020)

Very persistent random walkers reveal transitions in landscape topology
by: Kent-Dobias, Jaron
Published: (2025)

Driven dynamics of localization phase transition in the Aubry-André model with initial gapless extended states
by: Wang, Xin-Yu, et al.
Published: (2025)

BBP transition and the leading eigenvector of the spiked Wigner model with inhomogeneous noise
by: Ferreira, Leonardo S., et al.
Published: (2026)

Far-from-equilibrium complex landscapes
by: Guislain, Laura, et al.
Published: (2024)

Conditioning the complexity of random landscapes on marginal optima
by: Kent-Dobias, Jaron
Published: (2024)

Inferring Higher-Order Couplings with Neural Networks
by: Decelle, Aurélien, et al.
Published: (2025)

Learning and Testing Inverse Statistical Problems For Interacting Systems Undergoing Phase Transition
by: Bae, Stefano, et al.
Published: (2025)

Arrangement of nearby minima and saddles in the mixed spherical energy landscapes
by: Kent-Dobias, Jaron
Published: (2023)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions
by: Bae, Jaeyong, et al.
Published: (2024)

An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models
by: Mao, Jialin, et al.
Published: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

General theory for extended-range percolation on simple and multiplex networks
by: Cirigliano, Lorenzo, et al.
Published: (2024)

Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks
by: Tamai, Keiichi, et al.
Published: (2023)

A theoretical perspective on mode collapse in variational inference
by: Soletskyi, Roman, et al.
Published: (2024)

The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
by: Takahashi, Takashi
Published: (2022)

From Classical to Quantum: Extending Prometheus for Unsupervised Discovery of Phase Transitions in Three Dimensions and Quantum Systems
by: Yee, Brandon, et al.
Published: (2026)

Construction of a Neural Network with Temperature-Dependent Recall Patterns
by: Sasaki, Munetaka
Published: (2026)

Asymmetric simple exclusion process on the percolation cluster: Waiting time distribution in side-branches
by: Iyer, Chandrashekar, et al.
Published: (2023)

Triplets of local minima in a high-dimensional random landscape: Correlations, clustering, and memoryless activated jumps
by: Pacco, Alessandro, et al.
Published: (2024)

Cascade of phase transitions in the training of Energy-based models
by: Bachtis, Dimitrios, et al.
Published: (2024)

Self-consistent theory for sound propagation in a simple model of a disordered, harmonic solid
by: Szamel, Grzegorz
Published: (2024)

Machine learning the Ising transition: A comparison between discriminative and generative approaches
by: Zhang, Difei, et al.
Published: (2024)

Evidence that the AT transition disappears below six dimensions
by: Vedula, Bharadwaj, et al.
Published: (2024)

Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems
by: Angelini, Maria Chiara, et al.
Published: (2023)

Discontinuous transition in explosive percolation via local suppression
by: Cho, Young Sul
Published: (2025)

Interacting Copies of Random Constraint Satisfaction Problems
by: Angelini, Maria Chiara, et al.
Published: (2025)

Competing nonlinearities, criticality, and order-to-chaos transition in deep networks
by: Lesser, Omri, et al.
Published: (2026)

Phase probabilities in first-order transitions using machine learning
by: Sukhoverkhova, Diana, et al.
Published: (2024)

Delocalization-localization dynamical phase transition of random walks on graphs
by: Carugno, Giorgio, et al.
Published: (2022)

Re-entrant phase transitions induced by localization of zero-modes
by: Morone, Flaviano, et al.
Published: (2024)

Long-range spin glass in a field at zero temperature
by: Angelini, Maria Chiara, et al.
Published: (2026)

Bethe $M$-layer construction for the percolation problem
by: Angelini, Maria Chiara, et al.
Published: (2024)