Cover Image

Generalization performance of narrow one-hidden layer networks in the teacher-student setting

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ortiz, Rodrigo Pérez, Nwemadji, Gibbs, Barbier, Jean, Gerace, Federica, Ingrosso, Alessandro, Lauditi, Clarissa, Malatesta, Enrico M.
Format:	Preprint
Published:	2025
Subjects:	Disordered Systems and Neural Networks Machine Learning Probability Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Statistical mechanics of transfer learning in fully-connected networks in the proportional limit
by: Ingrosso, Alessandro, et al.
Published: (2024)

Random Features Hopfield Networks generalize retrieval to previously unseen examples
by: Kalaj, Silvio, et al.
Published: (2024)

Impact of dendritic non-linearities on the computational capabilities of neurons
by: Lauditi, Clarissa, et al.
Published: (2024)

Adaptive kernel predictors from feature-learning infinite limits of neural networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Properties of the geometry of solutions and capacity of multi-layer neural networks with Rectified Linear Units activations
by: Baldassi, Carlo, et al.
Published: (2019)

On the capacity of a quantum perceptron for storing biased patterns
by: Benatti, Fabio, et al.
Published: (2023)

Transfer Learning in Infinite Width Feature Learning Networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Exact full-RSB SAT/UNSAT transition in infinitely wide two-layer neural networks
by: Annesi, Brandon L., et al.
Published: (2024)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)

Sampling the space of solutions of an artificial neural network
by: Zambon, Alessandro, et al.
Published: (2025)

Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer
by: Lauditi, Clarissa, et al.
Published: (2026)

Kernel shape renormalization explains output-output correlations in finite Bayesian one-hidden-layer networks
by: Baglioni, P., et al.
Published: (2024)

The dimensionality of the Hopfield model
by: Erazo, Cristopher, et al.
Published: (2026)

The twin peaks of learning neural networks
by: Demyanenko, Elizaveta, et al.
Published: (2024)

Predictive power of a Bayesian effective action for fully-connected one hidden layer neural networks in the proportional limit
by: Baglioni, P., et al.
Published: (2024)

Bias-inducing geometries: an exactly solvable data model with fairness implications
by: Mannelli, Stefano Sarao, et al.
Published: (2022)

Mapping of attention mechanisms to a generalized Potts model
by: Rende, Riccardo, et al.
Published: (2023)

Rare Trajectories in a Prototypical Mean-field Disordered Model: Insights into Landscape and Instantons
by: Charbonneau, Patrick, et al.
Published: (2025)

High-dimensional learning of narrow neural networks
by: Cui, Hugo
Published: (2024)

Overlap Gap and Computational Thresholds in the Square Wave Perceptron
by: Benedetti, Marco, et al.
Published: (2025)

Testing Transformer Learnability on the Arithmetic Sequence of Rooted Trees
by: Breccia, Alessandro, et al.
Published: (2025)

Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)

Finding the right path: statistical mechanics of connected solutions in constraint satisfaction problems
by: Barbier, Damien
Published: (2025)

When low-loss paths make a binary neuron trainable: detecting algorithmic transitions with the connected ensemble
by: Barbier, Damien
Published: (2026)

The committee machine: Computational to statistical gaps in learning a two-layers neural network
by: Aubin, Benjamin, et al.
Published: (2018)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

Transparency versus Anderson localization in one-dimensional disordered stealthy hyperuniform layered media
by: Klatt, Michael A., et al.
Published: (2025)

Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022)

Exact capacity of the \emph{wide} hidden layer treelike neural networks with generic activations
by: Stojnic, Mihailo
Published: (2024)

Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers
by: Bassetti, Federico, et al.
Published: (2024)

Improving deep neural network performance through sampling
by: Ghantasala, Lakshmi A., et al.
Published: (2025)

How to escape atypical regions in the symmetric binary perceptron: a journey through connected-solutions states
by: Barbier, Damien
Published: (2024)

Random walk models for the propagation of signalling molecules in one-dimensional spatial networks and their continuum limit
by: Mehrpooya, Adel, et al.
Published: (2023)

Unifying view of fermionic neural network quantum states: From neural network backflow to hidden fermion determinant states
by: Liu, Zejun, et al.
Published: (2023)

Time-translation invariance symmetry breaking hidden by finite-scale singularities
by: Achitouv, Ixandra, et al.
Published: (2024)

Is the cortical dynamics ergodic? A numerical study in partially symmetric networks of spiking neurons
by: Tixidre, Ferdinand, et al.
Published: (2025)

Training neural networks with structured noise improves classification and generalization
by: Benedetti, Marco, et al.
Published: (2023)

Are Neural Networks Collision Resistant?
by: Benedetti, Marco, et al.
Published: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

On the Atypical Solutions of the Symmetric Binary Perceptron
by: Barbier, Damien, et al.
Published: (2023)