Cover Image

Dropout Regularization Versus $\ell_2$-Penalization in the Linear Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Clara, Gabriel, Langer, Sophie, Schmidt-Hieber, Johannes
Format:	Preprint
Published:	2023
Subjects:	Statistics Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
by: Clara, Gabriel, et al.
Published: (2025)

Asymptotics of Stochastic Gradient Descent with Dropout Regularization in Linear Models
by: Li, Jiaqi, et al.
Published: (2024)

On the VC dimension of deep group convolutional neural networks
by: Sepliarskaia, Anna, et al.
Published: (2024)

Spike-timing-dependent Hebbian learning as noisy gradient descent
by: Dexheimer, Niklas, et al.
Published: (2025)

Hyper Input Convex Neural Networks for Shape Constrained Learning and Optimal Transport
by: Hundrieser, Shayan, et al.
Published: (2026)

Improving the Convergence Rates of Forward Gradient Descent with Repeated Sampling
by: Dexheimer, Niklas, et al.
Published: (2024)

A novel statistical approach to analyze image classification
by: Chen, Juntong, et al.
Published: (2022)

Dropout Drops Double Descent
by: Yang, Tian-Le, et al.
Published: (2023)

Understanding the Effect of GCN Convolutions in Regression Tasks
by: Chen, Juntong, et al.
Published: (2024)

Transformed $\ell_1$ Regularizations for Robust Principal Component Analysis: Toward a Fine-Grained Understanding
by: Zhao, Kun, et al.
Published: (2025)

Regularization can make diffusion models more efficient
by: Taheri, Mahsa, et al.
Published: (2025)

Local convergence rates of the nonparametric least squares estimator with applications to transfer learning
by: Schmidt-Hieber, Johannes, et al.
Published: (2022)

$\ell_1$-Regularized Generalized Least Squares
by: Nobari, Kaveh S., et al.
Published: (2024)

Provable Generalization Bounds for Deep Neural Networks with Momentum-Adaptive Gradient Dropout
by: Safder, Adeel
Published: (2025)

Closed-form $\ell_r$ norm scaling with data for overparameterized linear regression and diagonal linear networks under $\ell_p$ bias
by: Zhang, Shuofeng, et al.
Published: (2025)

Structural Effect and Spectral Enhancement of High-Dimensional Regularized Linear Discriminant Analysis
by: Zhang, Yonghan, et al.
Published: (2025)

Lasso Penalization for High-Dimensional Beta Regression Models: Computation, Analysis, and Inference
by: Ramezani, Niloofar, et al.
Published: (2025)

Ordinal Patterns Based Change Points Detection
by: Betken, Annika, et al.
Published: (2025)

A Unified Framework for Pattern Recovery in Penalized and Thresholded Estimation and its Geometry
by: Graczyk, Piotr, et al.
Published: (2023)

Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Model
by: Luo, Wenya, et al.
Published: (2025)

Theoretical limits of descending $\ell_0$ sparse-regression ML algorithms
by: Stojnic, Mihailo
Published: (2024)

Regularized DeepIV with Model Selection
by: Li, Zihao, et al.
Published: (2024)

Linear Response Estimators for Singular Statistical Models
by: Elliott, Chris, et al.
Published: (2026)

Adaptive Refinement Protocols for Distributed Distribution Estimation under $\ell^p$-Losses
by: Yuan, Deheng, et al.
Published: (2024)

Self-Regularized Learning Methods
by: Schölpple, Max, et al.
Published: (2026)

Linear Convergence of Diffusion Models Under the Manifold Hypothesis
by: Potaptchik, Peter, et al.
Published: (2024)

Asymptotic Behavior of Adversarial Training Estimator under $\ell_\infty$-Perturbation
by: Xie, Yiling, et al.
Published: (2024)

Higher-Order Regularization Learning on Hypergraphs
by: Weihs, Adrien, et al.
Published: (2025)

Confidence Sequences for Generalized Linear Models via Regret Analysis
by: Clerico, Eugenio, et al.
Published: (2025)

Benign Overfitting in Time Series Linear Models with Over-Parameterization
by: Nakakita, Shogo, et al.
Published: (2022)

Generative Modelling via Quantile Regression
by: Schmidt-Hieber, Johannes, et al.
Published: (2024)

$L_2$-Regularized Empirical Risk Minimization Guarantees Small Smooth Calibration Error
by: Fujisawa, Masahiro, et al.
Published: (2025)

Double Descent: Understanding Linear Model Estimation of Nonidentifiable Parameters and a Model for Overfitting
by: Christensen, Ronald
Published: (2024)

Bagged Regularized $k$-Distances for Anomaly Detection
by: Cai, Yuchao, et al.
Published: (2023)

Implicit Regularization Paths of Weighted Neural Representations
by: Du, Jin-Hong, et al.
Published: (2024)

Optimal Ridge Regularization for Out-of-Distribution Prediction
by: Patil, Pratik, et al.
Published: (2024)

Precise Asymptotics of Bagging Regularized M-estimators
by: Koriyama, Takuya, et al.
Published: (2024)

BELIEF in Dependence: Leveraging Atomic Linearity in Data Bits for Rethinking Generalized Linear Models
by: Brown, Benjamin, et al.
Published: (2022)

On Linear Separability under Linear Compression with Applications to Hard Support Vector Machine
by: McVay, Paul, et al.
Published: (2022)

Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models
by: Zhang, Yihan, et al.
Published: (2022)