Imagen de Portada

The Price of Implicit Bias in Adversarially Robust Generalization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Tsilivis, Nikolaos, Frank, Natalie, Srebro, Nathan, Kempe, Julia
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
por: Tsilivis, Nikolaos, et al.
Publicado: (2024)

On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds
por: Vilucchio, Matteo, et al.
Publicado: (2024)

On the Robustness of Neural Collapse and the Neural Collapse of Robustness
por: Su, Jingtong, et al.
Publicado: (2023)

Attacking Bayes: On the Adversarial Robustness of Bayesian Neural Networks
por: Feng, Yunzhen, et al.
Publicado: (2024)

How Reinforcement Learning After Next-Token Prediction Facilitates Learning
por: Tsilivis, Nikolaos, et al.
Publicado: (2025)

Learning to Think from Multiple Thinkers
por: Joshi, Nirmit, et al.
Publicado: (2026)

The Implicit Bias of Gradient Descent on Separable Data
por: Soudry, Daniel, et al.
Publicado: (2017)

Can Implicit Bias Imply Adversarial Robustness?
por: Min, Hancheng, et al.
Publicado: (2024)

Quantifying Overfitting along the Regularization Path for Two-Part-Code MDL in Supervised Classification
por: Zhu, Xiaohan, et al.
Publicado: (2025)

Overfitting and Generalizing with (PAC) Bayesian Prediction in Noisy Binary Classification
por: Zhu, Xiaohan, et al.
Publicado: (2026)

How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers
por: Buzaglo, Gon, et al.
Publicado: (2024)

Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality
por: Medvedev, Marko, et al.
Publicado: (2024)

Noisy Interpolation Learning with Shallow Univariate ReLU Networks
por: Joshi, Nirmit, et al.
Publicado: (2023)

Adversarial Consistency and the Uniqueness of the Adversarial Bayes Classifier
por: Frank, Natalie S.
Publicado: (2024)

Recursive Models for Long-Horizon Reasoning
por: Yang, Chenxiao, et al.
Publicado: (2026)

The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains
por: Edelman, Benjamin L., et al.
Publicado: (2024)

Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
por: Harel, Itamar, et al.
Publicado: (2025)

On the Complexity of Learning Sparse Functions with Statistical and Gradient Queries
por: Joshi, Nirmit, et al.
Publicado: (2024)

Tight Bounds on the Binomial CDF, and the Minimum of i.i.d Binomials, in terms of KL-Divergence
por: Zhu, Xiaohan, et al.
Publicado: (2025)

DRoP: Distributionally Robust Data Pruning
por: Vysogorets, Artem, et al.
Publicado: (2024)

A Notion of Uniqueness for the Adversarial Bayes Classifier
por: Frank, Natalie S.
Publicado: (2024)

Adversarial Surrogate Risk Bounds for Binary Classification
por: Frank, Natalie S.
Publicado: (2025)

Shift is Good: Mismatched Data Mixing Improves Test Performance
por: Medvedev, Marko, et al.
Publicado: (2025)

Research Program: Theory of Learning in Dynamical Systems
por: Hazan, Elad, et al.
Publicado: (2025)

Weak-to-Strong Generalization Even in Random Feature Networks, Provably
por: Medvedev, Marko, et al.
Publicado: (2025)

Emergent properties with repeated examples
por: Charton, François, et al.
Publicado: (2024)

An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression
por: Zhou, Lijia, et al.
Publicado: (2023)

On the Hardness of Learning Regular Expressions
por: Attias, Idan, et al.
Publicado: (2025)

Learning single-index models via harmonic decomposition
por: Joshi, Nirmit, et al.
Publicado: (2025)

Depth Separation in Norm-Bounded Infinite-Width Neural Networks
por: Parkinson, Suzanna, et al.
Publicado: (2024)

PENCIL: Long Thoughts with Short Memory
por: Yang, Chenxiao, et al.
Publicado: (2025)

The Adversarial Consistency of Surrogate Risks for Binary Classification
por: Frank, Natalie, et al.
Publicado: (2023)

Frequency maps reveal the correlation between Adversarial Attacks and Implicit Bias
por: Basile, Lorenzo, et al.
Publicado: (2023)

The Implicit Bias of Logit Regularization
por: Beck, Alon, et al.
Publicado: (2026)

Adversarial Causal Tuning for Realistic Time-series Generation
por: Gkorgkolis, Nikolaos, et al.
Publicado: (2025)

Model Collapse Demystified: The Case of Regression
por: Dohmatob, Elvis, et al.
Publicado: (2024)

Deconstructing the Goldilocks Zone of Neural Network Initialization
por: Vysogorets, Artem, et al.
Publicado: (2024)

Outcome-based Exploration for LLM Reasoning
por: Song, Yuda, et al.
Publicado: (2025)

Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classification
por: Frank, Natalie S., et al.
Publicado: (2022)

Feature Averaging: An Implicit Bias of Gradient Descent Leading to Non-Robustness in Neural Networks
por: Li, Binghui, et al.
Publicado: (2024)