Image de couverture de livre

Asymptotics of Learning with Deep Structured (Random) Features

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Schröder, Dominik, Dmitriev, Daniil, Cui, Hugo, Loureiro, Bruno
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Disordered Systems and Neural Networks Statistics Theory
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
par: Vilucchio, Matteo, et autres
Publié: (2024)

High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
par: Adomaityte, Urte, et autres
Publié: (2023)

Gaussian Universality of Perceptrons with Random Labels
par: Gerace, Federica, et autres
Publié: (2022)

A theoretical perspective on mode collapse in variational inference
par: Soletskyi, Roman, et autres
Publié: (2024)

Asymmetric Scaling Laws from Sparse Features
par: Sous, John, et autres
Publié: (2026)

Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach
par: Adomaityte, Urte, et autres
Publié: (2023)

Asymptotics of feature learning in two-layer networks after one gradient-step
par: Cui, Hugo, et autres
Publié: (2024)

High-dimensional Asymptotics of Denoising Autoencoders
par: Cui, Hugo, et autres
Publié: (2023)

Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models
par: Mergny, Pierre, et autres
Publié: (2024)

Statistical Mechanics of Min-Max Problems
par: Ichikawa, Yuma, et autres
Publié: (2024)

Kernel Density Estimators in Large Dimensions
par: Biroli, Giulio, et autres
Publié: (2024)

Variational Gaussian Approximation in Replica Analysis of Parametric Models
par: Takahashi, Takashi
Publié: (2025)

Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
par: Mergny, Pierre, et autres
Publié: (2025)

Generalization Dynamics of Linear Diffusion Models
par: Merger, Claudia, et autres
Publié: (2025)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
par: Ishida, Yuichi, et autres
Publié: (2024)

Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
par: Arnaboldi, Luca, et autres
Publié: (2025)

Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis
par: Okajima, Koki, et autres
Publié: (2024)

The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
par: Takahashi, Takashi
Publié: (2022)

The Physics of Data and Tasks: Theories of Locality and Compositionality in Deep Learning
par: Favero, Alessandro
Publié: (2025)

The twin peaks of learning neural networks
par: Demyanenko, Elizaveta, et autres
Publié: (2024)

Precise asymptotic analysis of Sobolev training for random feature models
par: Fisher, Katharine E, et autres
Publié: (2025)

Generalization performance of narrow one-hidden layer networks in the teacher-student setting
par: Ortiz, Rodrigo Pérez, et autres
Publié: (2025)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
par: Malatesta, Enrico M.
Publié: (2023)

Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning
par: Dandi, Yatin, et autres
Publié: (2026)

High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator
par: Ichikawa, Yuma, et autres
Publié: (2025)

Distinct mechanisms underlying in-context learning in transformers
par: Gibson, Cole, et autres
Publié: (2026)

Dimension-free deterministic equivalents and scaling laws for random feature regression
par: Defilippis, Leonardo, et autres
Publié: (2024)

Gaussian mixtures and non-parametric likelihoods through the lens of statistical mechanics
par: Ghosh, Subhroshekhar, et autres
Publié: (2026)

Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks
par: Tamai, Keiichi, et autres
Publié: (2023)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
par: Huang, Jie, et autres
Publié: (2026)

Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions
par: Bae, Jaeyong, et autres
Publié: (2024)

High-dimensional learning of narrow neural networks
par: Cui, Hugo
Publié: (2024)

A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs
par: Tanner, Kasimir, et autres
Publié: (2024)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
par: Barbier, Jean, et autres
Publié: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
par: Nguyen, Minh-Toan, et autres
Publié: (2026)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
par: Cavaliere, Angelo Giorgio, et autres
Publié: (2025)

Limits of message passing for node classification: How class-bottlenecks restrict signal-to-noise ratio
par: Rubin, Jonathan, et autres
Publié: (2025)

Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks
par: Annesi, Brandon Livio, et autres
Publié: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
par: Barbier, Jean, et autres
Publié: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
par: Barbier, Jean, et autres
Publié: (2025)