Cover Image

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Barbier, Jean, Camilli, Francesco, Nguyen, Minh-Toan, Pastore, Mauro, Skerk, Rudy
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Disordered Systems and Neural Networks Statistical Mechanics Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

How to escape atypical regions in the symmetric binary perceptron: a journey through connected-solutions states
by: Barbier, Damien
Published: (2024)

Phase determination with and without deep learning
by: Çivitcioğlu, Burak, et al.
Published: (2024)

Finding the right path: statistical mechanics of connected solutions in constraint satisfaction problems
by: Barbier, Damien
Published: (2025)

When low-loss paths make a binary neuron trainable: detecting algorithmic transitions with the connected ensemble
by: Barbier, Damien
Published: (2026)

The committee machine: Computational to statistical gaps in learning a two-layers neural network
by: Aubin, Benjamin, et al.
Published: (2018)

Statistical mechanics of transfer learning in fully-connected networks in the proportional limit
by: Ingrosso, Alessandro, et al.
Published: (2024)

Statistical Mechanics of the Sub-Optimal Transport
by: Piombo, Riccardo, et al.
Published: (2026)

Guerra interpolation for inverse freezing
by: Albanese, Linda, et al.
Published: (2025)

Machine learning stochastic differential equations for the evolution of order parameters of classical many-body systems in and out of equilibrium
by: Carnazza, Francesco, et al.
Published: (2024)

Statistical physics through the lens of real-space mutual information
by: Gökmen, Doruk Efe, et al.
Published: (2021)

Multiple intermediate phases in the interpolating Aubry-André-Fibonacci model
by: Guo, Chenyue
Published: (2024)

Spring-block theory of feature learning in deep neural networks
by: Shi, Cheng, et al.
Published: (2024)

Estimating predictability of depinning dynamics by machine learning
by: Haavisto, Valtteri, et al.
Published: (2023)

Optimal Protocols for Continual Learning via Statistical Physics and Control Theory
by: Mori, Francesco, et al.
Published: (2024)

A statistical physics framework for optimal learning
by: Mignacco, Francesca, et al.
Published: (2025)

Microscopic and collective signatures of feature learning in neural networks
by: Corti, Andrea, et al.
Published: (2025)

Phase probabilities in first-order transitions using machine learning
by: Sukhoverkhova, Diana, et al.
Published: (2024)

What makes it possible to learn probability distributions in the natural world?
by: Bialek, William, et al.
Published: (2020)

Compressed sensing with l0-norm: statistical physics analysis and algorithms for signal recovery
by: Barbier, D., et al.
Published: (2023)

Machine learning analysis of dimensional reduction conjecture for nonequilibrium Berezinskii-Kosterlitz-Thouless transition in three dimensions
by: Haga, Taiki
Published: (2023)

Statistical mechanics of the majority game
by: Kozlowski, P., et al.
Published: (2003)

Bethe $M$-layer construction for the percolation problem
by: Angelini, Maria Chiara, et al.
Published: (2024)

Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime
by: Camilli, Francesco, et al.
Published: (2025)

Variational Evolutionary Network for Statistical Physics Systems
by: Ren, Yixiong, et al.
Published: (2024)

Optimized control protocols for stable skyrmion creation using deep reinforcement learning
by: Song, Ji Seok, et al.
Published: (2026)

Competing nonlinearities, criticality, and order-to-chaos transition in deep networks
by: Lesser, Omri, et al.
Published: (2026)

Roadmap on machine learning glassy dynamics
by: Jung, Gerhard, et al.
Published: (2023)

Statistical physics of principal minors: Cavity approach
by: Ramezanpour, A., et al.
Published: (2024)

Optimal quantum reservoir learning in proximity to universality
by: Ivaki, Moein N., et al.
Published: (2025)

Application of deep neural networks for computing the renormalization group flow of the two-dimensional phi^4 field theory
by: Zhao, Yueqi, et al.
Published: (2025)

Predictive power of a Bayesian effective action for fully-connected one hidden layer neural networks in the proportional limit
by: Baglioni, P., et al.
Published: (2024)

Preferential attachment and power-law degree distributions in heterogeneous multilayer hypergraphs
by: Di Lauro, Francesco, et al.
Published: (2025)

Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks
by: Coghi, Francesco, et al.
Published: (2024)

Logarithmic kinetics and bundling in physical networks
by: Bonamassa, I., et al.
Published: (2024)

Delocalization-localization dynamical phase transition of random walks on graphs
by: Carugno, Giorgio, et al.
Published: (2022)

On the structure factor of jammed particle configurations on the one-dimensional lattice
by: Luck, Jean-Marc
Published: (2023)

Machine learning of quantum channels on NISQ devices
by: Cemin, Giovanni, et al.
Published: (2024)