Cover Image

Generalization for Least Squares Regression With Simple Spiked Covariances

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Jiping, Sonthalia, Rishi
Format:	Preprint
Published:	2024
Subjects:	Statistics Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Least Squares Regression Can Exhibit Under-Parameterized Double Descent
by: Li, Xinyue, et al.
Published: (2023)

On Regularization via Early Stopping for Least Squares Regression
by: Sonthalia, Rishi, et al.
Published: (2024)

Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
by: Li, Jiping, et al.
Published: (2025)

Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
by: Kausik, Chinmaya, et al.
Published: (2023)

Convex Regression in Multidimensions: Suboptimality of Least Squares Estimators
by: Kur, Gil, et al.
Published: (2020)

Nearest Neighbor Matching as Least Squares Density Ratio Estimation and Riesz Regression
by: Kato, Masahiro
Published: (2025)

Ordinary Least Squares as an Attention Mechanism
by: Coulombe, Philippe Goulet
Published: (2025)

Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squares
by: Mergny, Pierre, et al.
Published: (2025)

Importance Weighting Correction of Regularized Least-Squares for Target Shift
by: Gogolashvili, Davit
Published: (2022)

Algebraic and Statistical Properties of the Ordinary Least Squares Interpolator
by: Shen, Dennis, et al.
Published: (2023)

Spectrally-Corrected and Regularized QDA Classifier for Spiked Covariance Model
by: Luo, Wenya, et al.
Published: (2025)

$\ell_1$-Regularized Generalized Least Squares
by: Nobari, Kaveh S., et al.
Published: (2024)

Nonparametric Instrumental Variable Regression with Observed Covariates
by: Shen, Zikai, et al.
Published: (2025)

Ordinary Least Squares is a Special Case of Transformer
by: Tan, Xiaojun, et al.
Published: (2026)

Federated PCA and Estimation for Spiked Covariance Matrices: Optimal Rates and Efficient Algorithm
by: Li, Jingyang, et al.
Published: (2024)

Inference in Randomized Least Squares and PCA via Normality of Quadratic Forms
by: Wang, Leda, et al.
Published: (2024)

Optimal Differentially Private PCA and Estimation for Spiked Covariance Matrices
by: Cai, T. Tony, et al.
Published: (2024)

Simple Relative Deviation Bounds for Covariance and Gram Matrices
by: Barzilai, Daniel, et al.
Published: (2024)

Prediction Risk and Estimation Risk of the Ridgeless Least Squares Estimator under General Assumptions on Regression Errors
by: Lee, Sungyoon, et al.
Published: (2023)

Self-Distillation is Optimal Among Spectral Shrinkage Estimators in Spiked Covariance Models
by: Lecoiu, Radu, et al.
Published: (2026)

Computation of Least Trimmed Squares: A Branch-and-Bound framework with Hyperplane Arrangement Enhancements
by: Meng, Xiang, et al.
Published: (2026)

Environment Invariant Linear Least Squares
by: Fan, Jianqing, et al.
Published: (2023)

The Thermodynamic Costs of Simple Linear Regression
by: D'Ambrosia, Samuel H., et al.
Published: (2026)

Online Covariance Estimation in Averaged SGD: Improved Batch-Mean Rates and Minimax Optimality via Trajectory Regression
by: Ni, Yijin, et al.
Published: (2026)

Probabilistic Analysis of Least Squares, Orthogonal Projection, and QR Factorization Algorithms Subject to Gaussian Noise
by: Lotfi, Ali, et al.
Published: (2024)

Mode-wise Principal Subspace Pursuit and Matrix Spiked Covariance Model
by: Tang, Runshi, et al.
Published: (2023)

Conformal Prediction Under Generalized Covariate Shift with Posterior Drift
by: Wang, Baozhen, et al.
Published: (2025)

Universal Approximation of Mean-Field Models via Transformers
by: Biswal, Shiba, et al.
Published: (2024)

Beyond Covariance Matrix: The Statistical Complexity of Private Linear Regression
by: Chen, Fan, et al.
Published: (2025)

Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy
by: Cai, T. Tony, et al.
Published: (2026)

Covariate Balancing and Riesz Regression Should Be Guided by the Neyman Orthogonal Score in Debiased Machine Learning
by: Kato, Masahiro
Published: (2026)

Kernel Debiased Plug-in Estimation based on the Universal Least Favorable Submodel
by: Chen, Haiyi, et al.
Published: (2026)

Generalized Bayesian Additive Regression Trees: Theory and Software
by: Saha, Enakshi
Published: (2023)

Iterative Reweighted Framework Based Algorithms for Sparse Linear Regression with Generalized Elastic Net Penalty
by: Ding, Yanyun, et al.
Published: (2024)

Covariate shift in nonparametric regression with Markovian design
by: Trottner, Lukas
Published: (2023)

Handling Covariate Mismatch in Federated Linear Prediction
by: Ayme, Alexis, et al.
Published: (2026)

Characterizing the Generalization Error of Random Feature Regression with Arbitrary Data-Augmentation
by: Morisset, Lucas, et al.
Published: (2026)

Local Learning for Covariate Selection in Nonparametric Causal Effect Estimation with Latent Variables
by: Li, Zheng, et al.
Published: (2024)

Sharp Generalization for Nonparametric Regression in Interpolation Space by Over-Parameterized Neural Networks Trained with Preconditioned Gradient Descent and Early Stopping
by: Yang, Yingzhen, et al.
Published: (2024)

Functional Partial Least-Squares: Adaptive Estimation and Inference
by: Babii, Andrii, et al.
Published: (2024)