Cover Image

Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Haas, Moritz, Holzmüller, David, von Luxburg, Ulrike, Steinwart, Ingo
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Self-Regularized Learning Methods
by: Schölpple, Max, et al.
Published: (2026)

Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias
by: Wong, Honam, et al.
Published: (2024)

Convergence Rates for Non-Log-Concave Sampling and Log-Partition Estimation
by: Holzmüller, David, et al.
Published: (2023)

Better by Default: Strong Pre-Tuned MLPs and Boosted Trees on Tabular Data
by: Holzmüller, David, et al.
Published: (2024)

Nonlinear spiked covariance matrices and signal propagation in deep neural networks
by: Wang, Zhichao, et al.
Published: (2024)

Nonparametric Instrumental Variable Regression with Observed Covariates
by: Shen, Zikai, et al.
Published: (2025)

On the VC dimension of deep group convolutional neural networks
by: Sepliarskaia, Anna, et al.
Published: (2024)

The phase diagram of kernel interpolation in large dimensions
by: Zhang, Haobo, et al.
Published: (2024)

A statistical theory of overfitting for imbalanced classification
by: Lyu, Jingyang, et al.
Published: (2025)

Conditioning of Banach Space Valued Gaussian Random Variables: An Approximation Approach Based on Martingales
by: Steinwart, Ingo
Published: (2024)

Which Spaces can be Embedded in Reproducing Kernel Hilbert Spaces?
by: Schölpple, Max, et al.
Published: (2023)

Gaussian mixture layers for neural networks
by: Chewi, Sinho, et al.
Published: (2025)

Benign overfitting in leaky ReLU networks with moderate input dimension
by: Karhadkar, Kedar, et al.
Published: (2024)

Beyond Benign Overfitting in Nadaraya-Watson Interpolators
by: Barzilai, Daniel, et al.
Published: (2025)

On the rates of convergence for learning with convolutional neural networks
by: Yang, Yunfei, et al.
Published: (2024)

Learning Curves and Benign Overfitting of Spectral Algorithms in Large Dimensions
by: Lu, Weihao, et al.
Published: (2026)

Transfer Learning for Benign Overfitting in High-Dimensional Linear Regression
by: Kim, Yeichan, et al.
Published: (2025)

Benign Overfitting in Time Series Linear Models with Over-Parameterization
by: Nakakita, Shogo, et al.
Published: (2022)

Convergence Analysis of a Greedy Algorithm for Conditioning Gaussian Random Variables
by: Winkle, Daniel, et al.
Published: (2025)

Posterior and variational inference for deep neural networks with heavy-tailed weights
by: Castillo, Ismaël, et al.
Published: (2024)

How many samples are needed to train a deep neural network?
by: Golestaneh, Pegah, et al.
Published: (2024)

The Strong, Weak and Benign Goodhart's law. An independence-free and paradigm-agnostic formalisation
by: Majka, Adrien, et al.
Published: (2025)

Benign Overfitting under Learning Rate Conditions for $α$ Sub-exponential Input
by: Okudo, Kota, et al.
Published: (2024)

Physics-informed kernel learning
by: Doumèche, Nathan, et al.
Published: (2024)

Sampling from multi-modal distributions with polynomial query complexity in fixed dimension via reverse diffusion
by: Vacher, Adrien, et al.
Published: (2024)

Nonparametric regression using over-parameterized shallow ReLU neural networks
by: Yang, Yunfei, et al.
Published: (2023)

The loss landscape of deep linear neural networks: a second-order analysis
by: Achour, El Mehdi, et al.
Published: (2021)

PAC-Bayesian risk bounds for fully connected deep neural network with Gaussian priors
by: Mai, The Tien
Published: (2025)

The surrogate Gibbs-posterior of a corrected stochastic MALA: Towards uncertainty quantification for neural networks
by: Bieringer, Sebastian, et al.
Published: (2023)

On the number of modes of Gaussian kernel density estimators
by: Geshkovski, Borjan, et al.
Published: (2024)

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
by: Frei, Spencer, et al.
Published: (2022)

Sliding down the stairs: how correlated latent variables accelerate learning with neural networks
by: Bardone, Lorenzo, et al.
Published: (2024)

Early stopping and polynomial smoothing in regression with reproducing kernels
by: Averyanov, Yaroslav, et al.
Published: (2020)

Scalable and adaptive prediction bands with kernel sum-of-squares
by: Allain, Louis, et al.
Published: (2025)

Gradient dynamics for low-rank fine-tuning beyond kernels
by: Dayi, Arif Kerem, et al.
Published: (2024)

Consistent model selection in the spiked Wigner model via AIC-type criteria
by: Mukherjee, Soumendu Sundar
Published: (2023)

Improved learning theory for kernel distribution regression with two-stage sampling
by: Bachoc, François, et al.
Published: (2023)

Consistent estimation of generative model representations in the data kernel perspective space
by: Acharyya, Aranyak, et al.
Published: (2024)

Eigen-convergence of Gaussian kernelized graph Laplacian by manifold heat interpolation
by: Cheng, Xiuyuan, et al.
Published: (2021)

Effective regions and kernels in continuous sparse regularisation, with application to sketched mixtures
by: De Castro, Yohann, et al.
Published: (2025)