Cover Image

On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vilucchio, Matteo, Tsilivis, Nikolaos, Loureiro, Bruno, Kempe, Julia
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Disordered Systems and Neural Networks Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs
by: Tanner, Kasimir, et al.
Published: (2024)

High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
by: Adomaityte, Urte, et al.
Published: (2023)

Asymptotics of Learning with Deep Structured (Random) Features
by: Schröder, Dominik, et al.
Published: (2024)

On the existence of consistent adversarial attacks in high-dimensional linear classification
by: Vilucchio, Matteo, et al.
Published: (2025)

A theoretical perspective on mode collapse in variational inference
by: Soletskyi, Roman, et al.
Published: (2024)

Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022)

Generalization Dynamics of Linear Diffusion Models
by: Merger, Claudia, et al.
Published: (2025)

Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach
by: Adomaityte, Urte, et al.
Published: (2023)

Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning
by: Dandi, Yatin, et al.
Published: (2026)

Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis
by: Okajima, Koki, et al.
Published: (2024)

High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator
by: Ichikawa, Yuma, et al.
Published: (2025)

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression
by: Clarté, Lucas, et al.
Published: (2024)

Optimal Spectral Transitions in High-Dimensional Multi-Index Models
by: Defilippis, Leonardo, et al.
Published: (2025)

The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
by: Takahashi, Takashi
Published: (2022)

The Role of the Time-Dependent Hessian in High-Dimensional Optimization
by: Bonnaire, Tony, et al.
Published: (2024)

Statistical Mechanics of Min-Max Problems
by: Ichikawa, Yuma, et al.
Published: (2024)

Asymmetric Scaling Laws from Sparse Features
by: Sous, John, et al.
Published: (2026)

Variational Gaussian Approximation in Replica Analysis of Parametric Models
by: Takahashi, Takashi
Published: (2025)

Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
by: Mergny, Pierre, et al.
Published: (2025)

Kernel Density Estimators in Large Dimensions
by: Biroli, Giulio, et al.
Published: (2024)

High-dimensional manifold of solutions in neural networks: insights from statistical physics
by: Malatesta, Enrico M.
Published: (2023)

Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
by: Arnaboldi, Luca, et al.
Published: (2025)

Generalization performance of narrow one-hidden layer networks in the teacher-student setting
by: Ortiz, Rodrigo Pérez, et al.
Published: (2025)

Asymptotics of feature learning in two-layer networks after one gradient-step
by: Cui, Hugo, et al.
Published: (2024)

Precise asymptotic analysis of Sobolev training for random feature models
by: Fisher, Katharine E, et al.
Published: (2025)

Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models
by: Mergny, Pierre, et al.
Published: (2024)

The twin peaks of learning neural networks
by: Demyanenko, Elizaveta, et al.
Published: (2024)

Ratio Divergence Learning Using Target Energy in Restricted Boltzmann Machines: Beyond Kullback--Leibler Divergence Learning
by: Ishida, Yuichi, et al.
Published: (2024)

Dimension-free deterministic equivalents and scaling laws for random feature regression
by: Defilippis, Leonardo, et al.
Published: (2024)

Gaussian mixtures and non-parametric likelihoods through the lens of statistical mechanics
by: Ghosh, Subhroshekhar, et al.
Published: (2026)

Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings
by: D'Amico, Francesco, et al.
Published: (2025)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
by: Huang, Jie, et al.
Published: (2026)

Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit
by: Meng, Lineghuan, et al.
Published: (2024)

Biased Generalization in Diffusion Models
by: Garnier-Brun, Jerome, et al.
Published: (2026)

High-dimensional random landscapes: from typical to large deviations
by: Ros, Valentina
Published: (2025)

Generalization vs. Specialization under Concept Shift
by: Nguyen, Alex, et al.
Published: (2024)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)

Limits of message passing for node classification: How class-bottlenecks restrict signal-to-noise ratio
by: Rubin, Jonathan, et al.
Published: (2025)