Cover Image

The committee machine: Computational to statistical gaps in learning a two-layers neural network

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Aubin, Benjamin, Maillard, Antoine, Barbier, Jean, Krzakala, Florent, Macris, Nicolas, Zdeborová, Lenka
Format:	Preprint
Published:	2018
Subjects:	Machine Learning Disordered Systems and Neural Networks Statistical Mechanics Computational Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective
by: Ghio, Davide, et al.
Published: (2023)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
by: Maillard, Antoine, et al.
Published: (2024)

Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications
by: Xu, Yizhou, et al.
Published: (2025)

Compressed sensing with l0-norm: statistical physics analysis and algorithms for signal recovery
by: Barbier, D., et al.
Published: (2023)

On the Atypical Solutions of the Symmetric Binary Perceptron
by: Barbier, Damien, et al.
Published: (2023)

Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)

The phase diagram of compressed sensing with $\ell_0$-norm regularization
by: Barbier, Damien, et al.
Published: (2024)

Learning with Restricted Boltzmann Machines: Asymptotics of AMP and GD in High Dimensions
by: Xu, Yizhou, et al.
Published: (2025)

Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Model
by: Tabanelli, Hugo, et al.
Published: (2025)

Quenches in the Sherrington-Kirkpatrick model
by: Erba, Vittorio, et al.
Published: (2024)

Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
by: Troiani, Emanuele, et al.
Published: (2025)

Counting and Hardness-of-Finding Fixed Points in Cellular Automata on Random Graphs
by: Koller, Cédric, et al.
Published: (2024)

Statistical mechanics of the maximum-average submatrix problem
by: Erba, Vittorio, et al.
Published: (2023)

Low-rank Matrix Estimation with Inhomogeneous Noise
by: Guionnet, Alice, et al.
Published: (2022)

Finding the right path: statistical mechanics of connected solutions in constraint satisfaction problems
by: Barbier, Damien
Published: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks
by: Erba, Vittorio, et al.
Published: (2025)

Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
by: Arnaboldi, Luca, et al.
Published: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Inference in Spreading Processes with Neural-Network Priors
by: Ghio, Davide, et al.
Published: (2025)

Memorisation, convergence and generalisation in generative models
by: Maillard, Antoine, et al.
Published: (2026)

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression
by: Clarté, Lucas, et al.
Published: (2024)

Microscopic and collective signatures of feature learning in neural networks
by: Corti, Andrea, et al.
Published: (2025)

Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022)

When low-loss paths make a binary neuron trainable: detecting algorithmic transitions with the connected ensemble
by: Barbier, Damien
Published: (2026)

Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens
by: Erba, Vittorio, et al.
Published: (2024)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

The planted XY model: thermodynamics and inference
by: Chen, Siyu, et al.
Published: (2022)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
by: Giorlandino, Alessio, et al.
Published: (2026)

Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws
by: Boncoraglio, Fabrizio, et al.
Published: (2025)

Fundamental computational limits of weak learnability in high-dimensional multi-index models
by: Troiani, Emanuele, et al.
Published: (2024)

Predictive power of a Bayesian effective action for fully-connected one hidden layer neural networks in the proportional limit
by: Baglioni, P., et al.
Published: (2024)

Optimal thresholds and algorithms for a model of multi-modal learning in high dimensions
by: Keup, Christian, et al.
Published: (2024)

Application of deep neural networks for computing the renormalization group flow of the two-dimensional phi^4 field theory
by: Zhao, Yueqi, et al.
Published: (2025)

Estimating predictability of depinning dynamics by machine learning
by: Haavisto, Valtteri, et al.
Published: (2023)

Coding schemes in neural networks learning classification tasks
by: van Meegen, Alexander, et al.
Published: (2024)

How to escape atypical regions in the symmetric binary perceptron: a journey through connected-solutions states
by: Barbier, Damien
Published: (2024)

Phase transitions in the mini-batch size for sparse and dense two-layer neural networks
by: Marino, Raffaele, et al.
Published: (2023)

Spring-block theory of feature learning in deep neural networks
by: Shi, Cheng, et al.
Published: (2024)