Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
Fuente:
arXiv
Saved in:
| Main Authors: | Kausik, Chinmaya, Srivastava, Kashvi, Sonthalia, Rishi |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
by: Li, Xinyue, et al.
Published: (2023)
by: Li, Xinyue, et al.
Published: (2023)
Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
by: Frei, Spencer, et al.
Published: (2022)
by: Frei, Spencer, et al.
Published: (2022)
Generalization for Least Squares Regression With Simple Spiked Covariances
by: Li, Jiping, et al.
Published: (2024)
by: Li, Jiping, et al.
Published: (2024)
Double Descent: Understanding Linear Model Estimation of Nonidentifiable Parameters and a Model for Overfitting
by: Christensen, Ronald
Published: (2024)
by: Christensen, Ronald
Published: (2024)
On Regularization via Early Stopping for Least Squares Regression
by: Sonthalia, Rishi, et al.
Published: (2024)
by: Sonthalia, Rishi, et al.
Published: (2024)
Benign Overfitting under Learning Rate Conditions for $α$ Sub-exponential Input
by: Okudo, Kota, et al.
Published: (2024)
by: Okudo, Kota, et al.
Published: (2024)
Dropout Drops Double Descent
by: Yang, Tian-Le, et al.
Published: (2023)
by: Yang, Tian-Le, et al.
Published: (2023)
Transfer Learning for Benign Overfitting in High-Dimensional Linear Regression
by: Kim, Yeichan, et al.
Published: (2025)
by: Kim, Yeichan, et al.
Published: (2025)
Benign Overfitting in Time Series Linear Models with Over-Parameterization
by: Nakakita, Shogo, et al.
Published: (2022)
by: Nakakita, Shogo, et al.
Published: (2022)
Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
by: Li, Jiping, et al.
Published: (2025)
by: Li, Jiping, et al.
Published: (2025)
Universality of Benign Overfitting in Binary Linear Classification
by: Hashimoto, Ichiro, et al.
Published: (2025)
by: Hashimoto, Ichiro, et al.
Published: (2025)
Assessing the Quality of Denoising Diffusion Models in Wasserstein Distance: Noisy Score and Optimal Bounds
by: Arsenyan, Vahan, et al.
Published: (2025)
by: Arsenyan, Vahan, et al.
Published: (2025)
Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust Optimization
by: Liu, Shuang, et al.
Published: (2025)
by: Liu, Shuang, et al.
Published: (2025)
Beyond Benign Overfitting in Nadaraya-Watson Interpolators
by: Barzilai, Daniel, et al.
Published: (2025)
by: Barzilai, Daniel, et al.
Published: (2025)
Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
by: Hashimoto, Ichiro
Published: (2025)
by: Hashimoto, Ichiro
Published: (2025)
Robust Predictive Uncertainty and Double Descent in Contaminated Bayesian Random Features
by: Caprio, Michele, et al.
Published: (2026)
by: Caprio, Michele, et al.
Published: (2026)
A Stein Gradient Descent Approach for Doubly Intractable Distributions
by: Lee, Heesang, et al.
Published: (2024)
by: Lee, Heesang, et al.
Published: (2024)
Multiple Testing of Linear Forms for Noisy Matrix Completion
by: Ma, Wanteng, et al.
Published: (2023)
by: Ma, Wanteng, et al.
Published: (2023)
Learning Curves and Benign Overfitting of Spectral Algorithms in Large Dimensions
by: Lu, Weihao, et al.
Published: (2026)
by: Lu, Weihao, et al.
Published: (2026)
Conformal Prediction under Levy-Prokhorov Distribution Shifts: Robustness to Local and Global Perturbations
by: Aolaritei, Liviu, et al.
Published: (2025)
by: Aolaritei, Liviu, et al.
Published: (2025)
Stress-Aware Learning under KL Drift via Trust-Decayed Mirror Descent
by: Raj, Gabriel Nixon
Published: (2025)
by: Raj, Gabriel Nixon
Published: (2025)
Universal Approximation of Mean-Field Models via Transformers
by: Biswal, Shiba, et al.
Published: (2024)
by: Biswal, Shiba, et al.
Published: (2024)
On Linear Separability under Linear Compression with Applications to Hard Support Vector Machine
by: McVay, Paul, et al.
Published: (2022)
by: McVay, Paul, et al.
Published: (2022)
Functional Linear Regression of Cumulative Distribution Functions
by: Zhang, Qian, et al.
Published: (2022)
by: Zhang, Qian, et al.
Published: (2022)
Minimax Linear Regression under the Quantile Risk
by: Hanchi, Ayoub El, et al.
Published: (2024)
by: Hanchi, Ayoub El, et al.
Published: (2024)
A Novel Framework for Policy Mirror Descent with General Parameterization and Linear Convergence
by: Alfano, Carlo, et al.
Published: (2023)
by: Alfano, Carlo, et al.
Published: (2023)
Overfitting has a limitation: a model-independent generalization gap bound based on Rényi entropy
by: Suzuki, Atsushi, et al.
Published: (2025)
by: Suzuki, Atsushi, et al.
Published: (2025)
Distribution Estimation under the Infinity Norm
by: Kontorovich, Aryeh, et al.
Published: (2024)
by: Kontorovich, Aryeh, et al.
Published: (2024)
Transfer Learning for High-dimensional Quantile Regression with Distribution Shift
by: Bai, Ruiqi, et al.
Published: (2024)
by: Bai, Ruiqi, et al.
Published: (2024)
Optimal Aggregation of Prediction Intervals under Unsupervised Domain Shift
by: Ge, Jiawei, et al.
Published: (2024)
by: Ge, Jiawei, et al.
Published: (2024)
Sample Complexity of Offline Distributionally Robust Linear Markov Decision Processes
by: Wang, He, et al.
Published: (2024)
by: Wang, He, et al.
Published: (2024)
Leveraging Offline Data in Linear Latent Contextual Bandits
by: Kausik, Chinmaya, et al.
Published: (2024)
by: Kausik, Chinmaya, et al.
Published: (2024)
Cyclic Counterfactuals under Shift-Scale Interventions
by: Saha, Saptarshi, et al.
Published: (2025)
by: Saha, Saptarshi, et al.
Published: (2025)
Path Regularization: A Near-Complete and Optimal Nonasymptotic Generalization Theory for Multilayer Neural Networks and Double Descent Phenomenon
by: Yu, Hao
Published: (2025)
by: Yu, Hao
Published: (2025)
Finite-Particle Rates for Regularized Stein Variational Gradient Descent
by: He, Ye, et al.
Published: (2026)
by: He, Ye, et al.
Published: (2026)
Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
by: Patil, Pratik, et al.
Published: (2024)
by: Patil, Pratik, et al.
Published: (2024)
Efficient and Multiply Robust Risk Estimation under General Forms of Dataset Shift
by: Qiu, Hongxiang, et al.
Published: (2023)
by: Qiu, Hongxiang, et al.
Published: (2023)
Interactive Learning of Single-Index Models via Stochastic Gradient Descent
by: Rajaraman, Nived, et al.
Published: (2026)
by: Rajaraman, Nived, et al.
Published: (2026)
Adaptive Refinement Protocols for Distributed Distribution Estimation under $\ell^p$-Losses
by: Yuan, Deheng, et al.
Published: (2024)
by: Yuan, Deheng, et al.
Published: (2024)
Distributed quasi-Newton robust estimation under differential privacy
by: Wang, Chuhan, et al.
Published: (2024)
by: Wang, Chuhan, et al.
Published: (2024)
Similar Items
-
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
by: Li, Xinyue, et al.
Published: (2023) -
Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
by: Frei, Spencer, et al.
Published: (2022) -
Generalization for Least Squares Regression With Simple Spiked Covariances
by: Li, Jiping, et al.
Published: (2024) -
Double Descent: Understanding Linear Model Estimation of Nonidentifiable Parameters and a Model for Overfitting
by: Christensen, Ronald
Published: (2024) -
On Regularization via Early Stopping for Least Squares Regression
by: Sonthalia, Rishi, et al.
Published: (2024)