Cover Image

Closed-form $\ell_r$ norm scaling with data for overparameterized linear regression and diagonal linear networks under $\ell_p$ bias

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Shuofeng, Louis, Ard
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Linear regression with overparameterized linear neural networks: Tight upper and lower bounds for implicit $\ell^1$-regularization
by: Matt, Hannes, et al.
Published: (2025)

Theoretical limits of descending $\ell_0$ sparse-regression ML algorithms
by: Stojnic, Mihailo
Published: (2024)

Adaptive Refinement Protocols for Distributed Distribution Estimation under $\ell^p$-Losses
by: Yuan, Deheng, et al.
Published: (2024)

Bayes optimal learning in high-dimensional linear regression with network side information
by: Nandy, Sagnik, et al.
Published: (2023)

Revisiting mean estimation over $\ell_p$ balls: Is the MLE optimal?
by: Aolaritei, Liviu, et al.
Published: (2025)

Iterative Refinement for $\ell_p$-norm Regression
by: Adil, Deeksha, et al.
Published: (2019)

Beyond $\ell_2$-norm and $\ell_\infty$-norm: A Curvature-Inspired $\ell_p$-Norm Scheme for Deep Neural Networks
by: Xu, Jianhao, et al.
Published: (2026)

Asymptotic Behavior of Adversarial Training Estimator under $\ell_\infty$-Perturbation
by: Xie, Yiling, et al.
Published: (2024)

Parametric Mean-Field empirical Bayes in high-dimensional linear regression
by: Lee, Seunghyun, et al.
Published: (2026)

Dropout Regularization Versus $\ell_2$-Penalization in the Linear Model
by: Clara, Gabriel, et al.
Published: (2023)

Estimation of sparse linear regression coefficients under $L$-subexponential covariates
by: Sasai, Takeyuki
Published: (2023)

Position: Many generalization measures for deep learning are fragile
by: Zhang, Shuofeng, et al.
Published: (2025)

Is model selection possible for the $\ell_p$-loss? PCO estimation for regression models
by: Lacour, Claire, et al.
Published: (2025)

Transformed $\ell_1$ Regularizations for Robust Principal Component Analysis: Toward a Fine-Grained Understanding
by: Zhao, Kun, et al.
Published: (2025)

The $\ell_r$-Levy-Grothendieck problem and $r\rightarrow p$ norms of Levy matrices
by: Ramanan, Kavita, et al.
Published: (2024)

Dimension-free bounds in high-dimensional linear regression via error-in-operator approach
by: Noskov, Fedor, et al.
Published: (2025)

Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance
by: Mai, The Tien
Published: (2024)

Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
by: Bocchi, Dario, et al.
Published: (2026)

Online Correlation Clustering: Simultaneously Optimizing All $\ell_p$-norms
by: Davies, Sami, et al.
Published: (2025)

On Traceability in $\ell_p$ Stochastic Convex Optimization
by: Voitovych, Sasha, et al.
Published: (2025)

Coresets for Multiple $\ell_p$ Regression
by: Woodruff, David P., et al.
Published: (2024)

The loss landscape of deep linear neural networks: a second-order analysis
by: Achour, El Mehdi, et al.
Published: (2021)

A variational Bayes approach to debiased inference for low-dimensional parameters in high-dimensional linear regression
by: Castillo, Ismaël, et al.
Published: (2024)

$\ell_1$-Regularized Generalized Least Squares
by: Nobari, Kaveh S., et al.
Published: (2024)

Estimating Higher-Order Mixed Memberships via the $\ell_{2,\infty}$ Tensor Perturbation Bound
by: Agterberg, Joshua, et al.
Published: (2022)

Optimality of Matrix Mechanism on $\ell_p^p$-metric
by: Liu, Jingcheng, et al.
Published: (2024)

Sharper Bounds for $\ell_p$ Sensitivity Sampling
by: Woodruff, David P., et al.
Published: (2023)

Optimal bounds for $\ell_p$ sensitivity sampling via $\ell_2$ augmentation
by: Munteanu, Alexander, et al.
Published: (2024)

A path-norm toolkit for modern networks: consequences, promises and challenges
by: Gonon, Antoine, et al.
Published: (2023)

High-dimensional linear regression inference via $\ell^2$ weak convergence
by: Fujimori, Kou, et al.
Published: (2026)

kTULA: A Langevin sampling algorithm with improved KL bounds under super-linear log-gradients
by: Lytras, Iosif, et al.
Published: (2025)

Softmax is $1/2$-Lipschitz: A tight bound across all $\ell_p$ norms
by: Nair, Pravin
Published: (2025)

Ledoit-Wolf linear shrinkage with unknown mean
by: Oriol, Benoit, et al.
Published: (2023)

Minimax rates of convergence for nonparametric regression under adversarial attacks
by: Peng, Jingfu, et al.
Published: (2024)

Dimension lower bounds for linear approaches to function approximation
by: Hsu, Daniel
Published: (2025)

Universality laws for Gaussian mixtures in generalized linear models
by: Dandi, Yatin, et al.
Published: (2023)

Semiparametric M-estimation with overparameterized neural networks
by: Yan, Shunxing, et al.
Published: (2025)

Nonparametric regression using over-parameterized shallow ReLU neural networks
by: Yang, Yunfei, et al.
Published: (2023)

Improved learning theory for kernel distribution regression with two-stage sampling
by: Bachoc, François, et al.
Published: (2023)

Sharp concentration of uniform generalization errors in binary linear classification
by: Nakakita, Shogo
Published: (2025)