Copertina

A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tanner, Kasimir, Vilucchio, Matteo, Loureiro, Bruno, Krzakala, Florent
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Disordered Systems and Neural Networks
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
di: Vilucchio, Matteo, et al.
Pubblicazione: (2024)

Optimal Spectral Transitions in High-Dimensional Multi-Index Models
di: Defilippis, Leonardo, et al.
Pubblicazione: (2025)

Deep Learning as Neural Low-Degree Filtering: A Spectral Theory of Hierarchical Feature Learning
di: Dandi, Yatin, et al.
Pubblicazione: (2026)

On the existence of consistent adversarial attacks in high-dimensional linear classification
di: Vilucchio, Matteo, et al.
Pubblicazione: (2025)

Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks
di: Arnaboldi, Luca, et al.
Pubblicazione: (2025)

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression
di: Clarté, Lucas, et al.
Pubblicazione: (2024)

Learning with Restricted Boltzmann Machines: Asymptotics of AMP and GD in High Dimensions
di: Xu, Yizhou, et al.
Pubblicazione: (2025)

Asymptotics of feature learning in two-layer networks after one gradient-step
di: Cui, Hugo, et al.
Pubblicazione: (2024)

Computational Thresholds in Multi-Modal Learning via the Spiked Matrix-Tensor Model
di: Tabanelli, Hugo, et al.
Pubblicazione: (2025)

Gaussian Universality of Perceptrons with Random Labels
di: Gerace, Federica, et al.
Pubblicazione: (2022)

Fundamental computational limits of weak learnability in high-dimensional multi-index models
di: Troiani, Emanuele, et al.
Pubblicazione: (2024)

Fundamental limits of learning in sequence multi-index models and deep attention networks: High-dimensional asymptotics and sharp thresholds
di: Troiani, Emanuele, et al.
Pubblicazione: (2025)

Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime
di: Defilippis, Leonardo, et al.
Pubblicazione: (2025)

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective
di: Ghio, Davide, et al.
Pubblicazione: (2023)

Spectral Phase Transition and Optimal PCA in Block-Structured Spiked models
di: Mergny, Pierre, et al.
Pubblicazione: (2024)

The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks
di: Erba, Vittorio, et al.
Pubblicazione: (2025)

Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws
di: Boncoraglio, Fabrizio, et al.
Pubblicazione: (2025)

Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit
di: Meng, Lineghuan, et al.
Pubblicazione: (2024)

Dimension-free deterministic equivalents and scaling laws for random feature regression
di: Defilippis, Leonardo, et al.
Pubblicazione: (2024)

Fundamental Limits of Matrix Sensing: Exact Asymptotics, Universality, and Applications
di: Xu, Yizhou, et al.
Pubblicazione: (2025)

Sharp description of local minima in the loss landscape of high-dimensional two-layer ReLU neural networks
di: Huang, Jie, et al.
Pubblicazione: (2026)

Statistical Advantage of Softmax Attention: Insights from Single-Location Regression
di: Duranthon, O., et al.
Pubblicazione: (2025)

Statistical mechanics of the maximum-average submatrix problem
di: Erba, Vittorio, et al.
Pubblicazione: (2023)

Bayes-optimal learning of an extensive-width neural network from quadratically many samples
di: Maillard, Antoine, et al.
Pubblicazione: (2024)

Emergence of Distortions in High-Dimensional Guided Diffusion Models
di: Ventura, Enrico, et al.
Pubblicazione: (2026)

Quenches in the Sherrington-Kirkpatrick model
di: Erba, Vittorio, et al.
Pubblicazione: (2024)

High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
di: Adomaityte, Urte, et al.
Pubblicazione: (2023)

The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold
di: Mao, Jialin, et al.
Pubblicazione: (2023)

High-Dimensional Limit of Stochastic Gradient Flow via Dynamical Mean-Field Theory
di: Nishiyama, Sota, et al.
Pubblicazione: (2026)

The committee machine: Computational to statistical gaps in learning a two-layers neural network
di: Aubin, Benjamin, et al.
Pubblicazione: (2018)

Topological Exploration of High-Dimensional Empirical Risk Landscapes: general approach, and applications to phase retrieval
di: Maillard, Antoine, et al.
Pubblicazione: (2026)

Diffusion Operator Geometry of Feedforward Representations
di: Reddy, Kanishka
Pubblicazione: (2026)

On the Atypical Solutions of the Symmetric Binary Perceptron
di: Barbier, Damien, et al.
Pubblicazione: (2023)

Asymptotics of Learning with Deep Structured (Random) Features
di: Schröder, Dominik, et al.
Pubblicazione: (2024)

Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Training
di: Bonnaire, Tony, et al.
Pubblicazione: (2025)

Statistical Mechanics Calculations Using Variational Autoregressive Networks and Quantum Annealing
di: Tamura, Yuta, et al.
Pubblicazione: (2024)

Self-attention as an attractor network: transient memories without backpropagation
di: D'Amico, Francesco, et al.
Pubblicazione: (2024)

Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens
di: Erba, Vittorio, et al.
Pubblicazione: (2024)

Statistical physics analysis of graph neural networks: Approaching optimality in the contextual stochastic block model
di: Duranthon, O., et al.
Pubblicazione: (2025)

Statistical Physics of Deep Neural Networks: Generalization Capability, Beyond the Infinite Width, and Feature Learning
di: Ariosto, Sebastiano
Pubblicazione: (2025)