Saved in:
| Main Authors: | Schröder, Dominik, Dmitriev, Daniil, Cui, Hugo, Loureiro, Bruno |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2402.13999 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
by: Vilucchio, Matteo, et al.
Published: (2024)
by: Vilucchio, Matteo, et al.
Published: (2024)
High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
by: Adomaityte, Urte, et al.
Published: (2023)
by: Adomaityte, Urte, et al.
Published: (2023)
Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022)
by: Gerace, Federica, et al.
Published: (2022)
A theoretical perspective on mode collapse in variational inference
by: Soletskyi, Roman, et al.
Published: (2024)
by: Soletskyi, Roman, et al.
Published: (2024)
Asymmetric Scaling Laws from Sparse Features
by: Sous, John, et al.
Published: (2026)
by: Sous, John, et al.
Published: (2026)
Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach
by: Adomaityte, Urte, et al.
Published: (2023)
by: Adomaityte, Urte, et al.
Published: (2023)
Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)
by: Cui, Hugo, et al.
Published: (2024)
Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models
by: Mergny, Pierre, et al.
Published: (2024)
by: Mergny, Pierre, et al.
Published: (2024)
Statistical Mechanics of Min-Max Problems
by: Ichikawa, Yuma, et al.
Published: (2024)
by: Ichikawa, Yuma, et al.
Published: (2024)
Kernel Density Estimators in Large Dimensions
by: Biroli, Giulio, et al.
Published: (2024)
by: Biroli, Giulio, et al.
Published: (2024)
Variational Gaussian Approximation in Replica Analysis of Parametric Models
by: Takahashi, Takashi
Published: (2025)
by: Takahashi, Takashi
Published: (2025)
Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
by: Mergny, Pierre, et al.
Published: (2025)
by: Mergny, Pierre, et al.
Published: (2025)
Generalization Dynamics of Linear Diffusion Models
by: Merger, Claudia, et al.
Published: (2025)
by: Merger, Claudia, et al.
Published: (2025)
High-dimensional Asymptotics of Denoising Autoencoders
by: Cui, Hugo, et al.
Published: (2023)
by: Cui, Hugo, et al.
Published: (2023)
Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
by: Ishida, Yuichi, et al.
Published: (2024)
by: Ishida, Yuichi, et al.
Published: (2024)
Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
by: Arnaboldi, Luca, et al.
Published: (2025)
by: Arnaboldi, Luca, et al.
Published: (2025)
Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis
by: Okajima, Koki, et al.
Published: (2024)
by: Okajima, Koki, et al.
Published: (2024)
The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
by: Takahashi, Takashi
Published: (2022)
by: Takahashi, Takashi
Published: (2022)
The twin peaks of learning neural networks
by: Demyanenko, Elizaveta, et al.
Published: (2024)
by: Demyanenko, Elizaveta, et al.
Published: (2024)
Precise asymptotic analysis of Sobolev training for random feature models
by: Fisher, Katharine E, et al.
Published: (2025)
by: Fisher, Katharine E, et al.
Published: (2025)
Generalization performance of narrow one-hidden layer networks in the teacher-student setting
by: Ortiz, Rodrigo Pérez, et al.
Published: (2025)
by: Ortiz, Rodrigo Pérez, et al.
Published: (2025)
High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)
by: Malatesta, Enrico M.
Published: (2023)
The Physics of Data and Tasks: Theories of Locality and Compositionality in Deep Learning
by: Favero, Alessandro
Published: (2025)
by: Favero, Alessandro
Published: (2025)
High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator
by: Ichikawa, Yuma, et al.
Published: (2025)
by: Ichikawa, Yuma, et al.
Published: (2025)
Gaussian mixtures and non-parametric likelihoods through the lens of statistical mechanics
by: Ghosh, Subhroshekhar, et al.
Published: (2026)
by: Ghosh, Subhroshekhar, et al.
Published: (2026)
Distinct mechanisms underlying in-context learning in transformers
by: Gibson, Cole, et al.
Published: (2026)
by: Gibson, Cole, et al.
Published: (2026)
Dimension-free deterministic equivalents and scaling laws for random feature regression
by: Defilippis, Leonardo, et al.
Published: (2024)
by: Defilippis, Leonardo, et al.
Published: (2024)
Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning
by: Dandi, Yatin, et al.
Published: (2026)
by: Dandi, Yatin, et al.
Published: (2026)
Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)
by: Barbier, Jean, et al.
Published: (2025)
Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)
by: Nguyen, Minh-Toan, et al.
Published: (2026)
Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)
Limits of message passing for node classification: How class-bottlenecks restrict signal-to-noise ratio
by: Rubin, Jonathan, et al.
Published: (2025)
by: Rubin, Jonathan, et al.
Published: (2025)
Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks
by: Annesi, Brandon Livio, et al.
Published: (2025)
by: Annesi, Brandon Livio, et al.
Published: (2025)
Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)
by: Barbier, Jean, et al.
Published: (2025)
Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)
by: Barbier, Jean, et al.
Published: (2025)
Analysis of Diffusion Models for Manifold Data
by: George, Anand Jerry, et al.
Published: (2025)
by: George, Anand Jerry, et al.
Published: (2025)
Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)
by: Huang, Jie, et al.
Published: (2026)
Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks
by: Tamai, Keiichi, et al.
Published: (2023)
by: Tamai, Keiichi, et al.
Published: (2023)
Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions
by: Bae, Jaeyong, et al.
Published: (2024)
by: Bae, Jaeyong, et al.
Published: (2024)
A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs
by: Tanner, Kasimir, et al.
Published: (2024)
by: Tanner, Kasimir, et al.
Published: (2024)
Similar Items
-
On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
by: Vilucchio, Matteo, et al.
Published: (2024) -
High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
by: Adomaityte, Urte, et al.
Published: (2023) -
Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022) -
A theoretical perspective on mode collapse in variational inference
by: Soletskyi, Roman, et al.
Published: (2024) -
Asymmetric Scaling Laws from Sparse Features
by: Sous, John, et al.
Published: (2026)