Cover Image

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Frei, Spencer, Chatterji, Niladri S., Bartlett, Peter L.
Format:	Preprint
Published:	2022
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
by: Kausik, Chinmaya, et al.
Published: (2023)

Benign Overfitting in Time Series Linear Models with Over-Parameterization
by: Nakakita, Shogo, et al.
Published: (2022)

Transfer Learning for Benign Overfitting in High-Dimensional Linear Regression
by: Kim, Yeichan, et al.
Published: (2025)

Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
by: Hashimoto, Ichiro
Published: (2025)

Universality of Benign Overfitting in Binary Linear Classification
by: Hashimoto, Ichiro, et al.
Published: (2025)

Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context
by: Frei, Spencer, et al.
Published: (2024)

Double Descent: Understanding Linear Model Estimation of Nonidentifiable Parameters and a Model for Overfitting
by: Christensen, Ronald
Published: (2024)

Improved Scaling Laws in Linear Regression via Data Reuse
by: Lin, Licong, et al.
Published: (2025)

Beyond Benign Overfitting in Nadaraya-Watson Interpolators
by: Barzilai, Daniel, et al.
Published: (2025)

Learning Curves and Benign Overfitting of Spectral Algorithms in Large Dimensions
by: Lu, Weihao, et al.
Published: (2026)

Benign Overfitting and the Geometry of the Ridge Regression Solution in Binary Classification
by: Tsigler, Alexander, et al.
Published: (2025)

Benign Overfitting under Learning Rate Conditions for $α$ Sub-exponential Input
by: Okudo, Kota, et al.
Published: (2024)

Scaling Laws in Linear Regression: Compute, Parameters, and Data
by: Lin, Licong, et al.
Published: (2024)

Sharp Generalization for Nonparametric Regression in Interpolation Space by Over-Parameterized Neural Networks Trained with Preconditioned Gradient Descent and Early Stopping
by: Yang, Yingzhen, et al.
Published: (2024)

A Statistical Analysis of Wasserstein Autoencoders for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2024)

A Statistical Analysis for Supervised Deep Learning with Exponential Families for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2024)

Benign Overfitting in Linear Classifiers with a Bias Term
by: Kondo, Yuta
Published: (2025)

Multiple Testing of Linear Forms for Noisy Matrix Completion
by: Ma, Wanteng, et al.
Published: (2023)

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
by: Clara, Gabriel, et al.
Published: (2025)

Belted and Ensembled Neural Network for Linear and Nonlinear Sufficient Dimension Reduction
by: Tang, Yin, et al.
Published: (2024)

Gradient Descent with Projection Finds Over-Parameterized Neural Networks for Learning Low-Degree Polynomials with Nearly Minimax Optimal Rate
by: Yang, Yingzhen, et al.
Published: (2026)

On the Statistical Properties of Generative Adversarial Models for Low Intrinsic Data Dimension
by: Chakraborty, Saptarshi, et al.
Published: (2024)

A Statistical Analysis of Deep Federated Learning for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2024)

Decentralized Sparse Linear Regression via Gradient-Tracking: Linear Convergence and Statistical Guarantees
by: Maros, Marie, et al.
Published: (2022)

Understanding Learning Invariance in Deep Linear Networks
by: Duan, Hao, et al.
Published: (2025)

A Novel Framework for Policy Mirror Descent with General Parameterization and Linear Convergence
by: Alfano, Carlo, et al.
Published: (2023)

The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
by: Takahashi, Takashi
Published: (2022)

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
by: Rangriz, Parsa
Published: (2025)

A Stein Gradient Descent Approach for Doubly Intractable Distributions
by: Lee, Heesang, et al.
Published: (2024)

Finite-Particle Rates for Regularized Stein Variational Gradient Descent
by: He, Ye, et al.
Published: (2026)

Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
by: Patil, Pratik, et al.
Published: (2024)

Asymptotics of Stochastic Gradient Descent with Dropout Regularization in Linear Models
by: Li, Jiaqi, et al.
Published: (2024)

Generalization Properties of Score-matching Diffusion Models for Intrinsically Low-dimensional Data
by: Chakraborty, Saptarshi, et al.
Published: (2026)

BELIEF in Dependence: Leveraging Atomic Linearity in Data Bits for Rethinking Generalized Linear Models
by: Brown, Benjamin, et al.
Published: (2022)

Interactive Learning of Single-Index Models via Stochastic Gradient Descent
by: Rajaraman, Nived, et al.
Published: (2026)

Benign Overfitting in Single-Head Attention
by: Magen, Roey, et al.
Published: (2024)

Linear Convergence of Diffusion Models Under the Manifold Hypothesis
by: Potaptchik, Peter, et al.
Published: (2024)

On Linear Separability under Linear Compression with Applications to Hard Support Vector Machine
by: McVay, Paul, et al.
Published: (2022)

Statistical Verification of Linear Classifiers
by: Zhiyanov, Anton, et al.
Published: (2025)

A Linear Approach to Data Poisoning
by: Flynn, Donald, et al.
Published: (2025)