Cover Image

An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Lijia, Simon, James B., Vardi, Gal, Srebro, Nathan
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality
by: Medvedev, Marko, et al.
Published: (2024)

Provable Tempered Overfitting of Minimal Nets and Typical Nets
by: Harel, Itamar, et al.
Published: (2024)

Noisy Interpolation Learning with Shallow Univariate ReLU Networks
by: Joshi, Nirmit, et al.
Published: (2023)

To Grok Grokking: Provable Grokking in Ridge Regression
by: Xu, Mingyue, et al.
Published: (2026)

On the Hardness of Learning Regular Expressions
by: Attias, Idan, et al.
Published: (2025)

Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context
by: Frei, Spencer, et al.
Published: (2024)

Quantifying Overfitting along the Regularization Path for Two-Part-Code MDL in Supervised Classification
by: Zhu, Xiaohan, et al.
Published: (2025)

Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
by: Harel, Itamar, et al.
Published: (2025)

Overfitting and Generalizing with (PAC) Bayesian Prediction in Noisy Binary Classification
by: Zhu, Xiaohan, et al.
Published: (2026)

Learning to Think from Multiple Thinkers
by: Joshi, Nirmit, et al.
Published: (2026)

Positive Distribution Shift as a Framework for Understanding Tractable Learning
by: Medvedev, Marko, et al.
Published: (2026)

Benign Overfitting in Single-Head Attention
by: Magen, Roey, et al.
Published: (2024)

A Theory of Learning with Autoregressive Chain of Thought
by: Joshi, Nirmit, et al.
Published: (2025)

Characterizing Overfitting in Kernel Ridgeless Regression Through the Eigenspectrum
by: Cheng, Tin Sum, et al.
Published: (2024)

Benign Overfitting and the Geometry of the Ridge Regression Solution in Binary Classification
by: Tsigler, Alexander, et al.
Published: (2025)

Large Dimensional Kernel Ridge Regression: Extending to Product Kernels
by: Zhou, Yang, et al.
Published: (2026)

The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks
by: Gronich, Eitan, et al.
Published: (2026)

Transformers are almost optimal metalearners for linear classification
by: Magen, Roey, et al.
Published: (2025)

On the Saturation Effect of Kernel Ridge Regression
by: Li, Yicheng, et al.
Published: (2024)

Kernel Ridge Regression Inference
by: Singh, Rahul, et al.
Published: (2023)

Adjusted Overfitting Regression
by: Wilson, Dylan
Published: (2024)

Lepskii Principle for Distributed Kernel Ridge Regression
by: Lin, Shao-Bo
Published: (2024)

Transfer Learning of CATE with Kernel Ridge Regression
by: Kim, Seok-Jin, et al.
Published: (2025)

Optimal Rates and Saturation for Noiseless Kernel Ridge Regression
by: Long, Jihao, et al.
Published: (2024)

Differentiable Kernel Ridge Regression for Deep Learning Pipelines
by: Mercier, Jean-Marc, et al.
Published: (2026)

Benign Overfitting with Quantum Kernels
by: Tomasi, Joachim, et al.
Published: (2025)

Implicit Regularization Towards Rank Minimization in ReLU Networks
by: Timor, Nadav, et al.
Published: (2022)

Cubit: Token Mixer with Kernel Ridge Regression
by: Zheng, Chuanyang, et al.
Published: (2026)

Computational Efficiency under Covariate Shift in Kernel Ridge Regression
by: Della Vecchia, Andrea, et al.
Published: (2025)

On the Robustness of Kernel Ridge Regression Using the Cauchy Loss Function
by: Wen, Hongwei, et al.
Published: (2025)

Learning Multi-Index Models with Hyper-Kernel Ridge Regression
by: Huang, Shuo, et al.
Published: (2025)

A Comprehensive Analysis on the Learning Curve in Kernel Ridge Regression
by: Cheng, Tin Sum, et al.
Published: (2024)

Provable Privacy Attacks on Trained Shallow Neural Networks
by: Smorodinsky, Guy, et al.
Published: (2024)

Malign Overfitting: Interpolation Can Provably Preclude Invariance
by: Wald, Yoav, et al.
Published: (2022)

Testing for Overfitting
by: Schmidt, James
Published: (2023)

Recursive Models for Long-Horizon Reasoning
by: Yang, Chenxiao, et al.
Published: (2026)

Optimal Rates of Kernel Ridge Regression under Source Condition in Large Dimensions
by: Zhang, Haobo, et al.
Published: (2024)

On the Complexity of Learning Sparse Functions with Statistical and Gradient Queries
by: Joshi, Nirmit, et al.
Published: (2024)

Tight Bounds on the Binomial CDF, and the Minimum of i.i.d Binomials, in terms of KL-Divergence
by: Zhu, Xiaohan, et al.
Published: (2025)

Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks
by: Tsilivis, Nikolaos, et al.
Published: (2024)