Cover Image

Learning Curves and Benign Overfitting of Spectral Algorithms in Large Dimensions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lu, Weihao, Lin, Qian, Xia, Yingcun, Huang, Dongming
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Statistics Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Consistency for Large Neural Networks: Regression and Classification
by: Zhan, Haoran, et al.
Published: (2024)

Transfer Learning for Benign Overfitting in High-Dimensional Linear Regression
by: Kim, Yeichan, et al.
Published: (2025)

Beyond Benign Overfitting in Nadaraya-Watson Interpolators
by: Barzilai, Daniel, et al.
Published: (2025)

Benign Overfitting under Learning Rate Conditions for $α$ Sub-exponential Input
by: Okudo, Kota, et al.
Published: (2024)

Benign Overfitting in Time Series Linear Models with Over-Parameterization
by: Nakakita, Shogo, et al.
Published: (2022)

Alignment-Sensitive Minimax Rates for Spectral Algorithms with Learned Kernels
by: Huang, Dongming, et al.
Published: (2025)

Generalization Error Curves for Analytic Spectral Algorithms under Power-law Decay
by: Li, Yicheng, et al.
Published: (2024)

Universality of Benign Overfitting in Binary Linear Classification
by: Hashimoto, Ichiro, et al.
Published: (2025)

Spectral-Transport Stability and Benign Overfitting in Interpolating Learning
by: Fredriksson-Imanov, Gustav Olaf Yunus Laitinen-Lundström
Published: (2026)

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
by: Frei, Spencer, et al.
Published: (2022)

On the Optimality of Misspecified Spectral Algorithms
by: Zhang, Haobo, et al.
Published: (2023)

The phase diagram of kernel interpolation in large dimensions
by: Zhang, Haobo, et al.
Published: (2024)

Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias
by: Wong, Honam, et al.
Published: (2024)

Optimal Rate of Kernel Regression in Large Dimensions
by: Lu, Weihao, et al.
Published: (2023)

Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
by: Hashimoto, Ichiro
Published: (2025)

On the Saturation Effects of Spectral Algorithms in Large Dimensions
by: Lu, Weihao, et al.
Published: (2025)

Non-asymptotic Properties of Generalized Mondrian Forests in Statistical Learning
by: Zhan, Haoran, et al.
Published: (2024)

The Catastrophic Failure of The k-Means Algorithm in High Dimensions, and How Hartigan's Algorithm Avoids It
by: Lederman, Roy R., et al.
Published: (2026)

Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
by: Kausik, Chinmaya, et al.
Published: (2023)

Double Descent: Understanding Linear Model Estimation of Nonidentifiable Parameters and a Model for Overfitting
by: Christensen, Ronald
Published: (2024)

Regularization Using Synthetic Data in High-Dimensional Models
by: Li, Weihao, et al.
Published: (2024)

On Learning-Curve Monotonicity for Maximum Likelihood Estimators
by: Sellke, Mark, et al.
Published: (2025)

Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension
by: Haas, Moritz, et al.
Published: (2023)

On Spectral Learning for Odeco Tensors: Perturbation, Initialization, and Algorithms
by: Auddy, Arnab, et al.
Published: (2025)

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms
by: Collins-Woodfin, Elizabeth, et al.
Published: (2024)

The Strong, Weak and Benign Goodhart's law. An independence-free and paradigm-agnostic formalisation
by: Majka, Adrien, et al.
Published: (2025)

Consistency of Oblique Decision Tree and its Boosting and Random Forest
by: Zhan, Haoran, et al.
Published: (2022)

Learning Spectral Methods by Transformers
by: He, Yihan, et al.
Published: (2025)

Overfitting has a limitation: a model-independent generalization gap bound based on Rényi entropy
by: Suzuki, Atsushi, et al.
Published: (2025)

Provable Robust Overfitting Mitigation in Wasserstein Distributionally Robust Optimization
by: Liu, Shuang, et al.
Published: (2025)

On the Pinsker bound of inner product kernel regression in large dimensions
by: Lu, Weihao, et al.
Published: (2024)

The Fragility of Optimized Bandit Algorithms
by: Fan, Lin, et al.
Published: (2021)

Generalized Robust Adaptive-Bandwidth Multi-View Manifold Learning in High Dimensions with Noise
by: Ding, Xiucai, et al.
Published: (2026)

Kernel Two-Sample Tests in High Dimension: Interplay Between Moment Discrepancy and Dimension-and-Sample Orders
by: Yan, Jian, et al.
Published: (2021)

Attributed Network Alignment: Statistical Limits and Efficient Algorithm
by: Huang, Dong, et al.
Published: (2026)

Federated PCA and Estimation for Spiked Covariance Matrices: Optimal Rates and Efficient Algorithm
by: Li, Jingyang, et al.
Published: (2024)

Dimension lower bounds for linear approaches to function approximation
by: Hsu, Daniel
Published: (2025)

Optimal Confidence Band for Kernel Gradient Flow Estimator
by: Cheng, Yuqian, et al.
Published: (2026)

Dimension-free Score Matching and Time Bootstrapping for Diffusion Models
by: Kumar, Syamantak, et al.
Published: (2025)

Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions
by: Azangulov, Iskander, et al.
Published: (2024)