Copertina

Sharp Generalization for Nonparametric Regression in Interpolation Space by Over-Parameterized Neural Networks Trained with Preconditioned Gradient Descent and Early Stopping

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yang, Yingzhen, Li, Ping
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Statistics Theory
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression
di: Yang, Yingzhen, et al.
Pubblicazione: (2024)

Gradient Descent with Projection Finds Over-Parameterized Neural Networks for Learning Low-Degree Polynomials with Nearly Minimax Optimal Rate
di: Yang, Yingzhen, et al.
Pubblicazione: (2026)

Sharp Risk Bounds for Early-Stopping in Gaussian Linear Regression
di: Wegel, Tobias, et al.
Pubblicazione: (2025)

Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent
di: Patil, Pratik, et al.
Pubblicazione: (2024)

Least Squares Regression Can Exhibit Under-Parameterized Double Descent
di: Li, Xinyue, et al.
Pubblicazione: (2023)

Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data
di: Frei, Spencer, et al.
Pubblicazione: (2022)

Inference for Deep Neural Network Estimators in Generalized Nonparametric Models
di: Meng, Xuran, et al.
Pubblicazione: (2025)

Learning Operators with Stochastic Gradient Descent in General Hilbert Spaces
di: Shi, Lei, et al.
Pubblicazione: (2024)

Minimax Adaptive Online Nonparametric Regression over Besov Spaces
di: Liautaud, Paul, et al.
Pubblicazione: (2025)

Stopping Rules for Stochastic Gradient Descent via Anytime-Valid Confidence Sequences
di: Aolaritei, Liviu, et al.
Pubblicazione: (2025)

On Regularization via Early Stopping for Least Squares Regression
di: Sonthalia, Rishi, et al.
Pubblicazione: (2024)

Convex SGD: Generalization Without Early Stopping
di: Hendrickx, Julien, et al.
Pubblicazione: (2024)

Nonparametric Instrumental Variable Regression with Observed Covariates
di: Shen, Zikai, et al.
Pubblicazione: (2025)

Random Matrix Theory of Early-Stopped Gradient Flow: A Transient BBP Scenario
di: Coeurdoux, Florentin, et al.
Pubblicazione: (2026)

Online Quantile Regression for Nonparametric Additive Models
di: Zhan, Haoran
Pubblicazione: (2026)

The Adaptivity Barrier in Batched Nonparametric Bandits: Sharp Characterization of the Price of Unknown Margin
di: Jiang, Rong, et al.
Pubblicazione: (2025)

Nested Nonparametric Instrumental Variable Regression
di: Meza, Isaac, et al.
Pubblicazione: (2021)

Minimax-optimal and Locally-adaptive Online Nonparametric Regression
di: Liautaud, Paul, et al.
Pubblicazione: (2024)

Nonsmooth Nonparametric Regression via Fractional Laplacian Eigenmaps
di: Shi, Zhaoyang, et al.
Pubblicazione: (2024)

A Novel Framework for Policy Mirror Descent with General Parameterization and Linear Convergence
di: Alfano, Carlo, et al.
Pubblicazione: (2023)

Benign Overfitting in Time Series Linear Models with Over-Parameterization
di: Nakakita, Shogo, et al.
Pubblicazione: (2022)

Training Diagonal Linear Networks with Stochastic Sharpness-Aware Minimization
di: Clara, Gabriel, et al.
Pubblicazione: (2025)

On the Interpolation Error of Nonlinear Attention versus Linear Regression
di: Liao, Zhenyu, et al.
Pubblicazione: (2025)

Differentially Private Two-Stage Gradient Descent for Instrumental Variable Regression
di: Liang, Haodong, et al.
Pubblicazione: (2025)

Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization
di: Zhang, Gavin, et al.
Pubblicazione: (2025)

Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks
di: Rangriz, Parsa
Pubblicazione: (2025)

Consistency for Large Neural Networks: Regression and Classification
di: Zhan, Haoran, et al.
Pubblicazione: (2024)

A Stein Gradient Descent Approach for Doubly Intractable Distributions
di: Lee, Heesang, et al.
Pubblicazione: (2024)

Finite-Particle Rates for Regularized Stein Variational Gradient Descent
di: He, Ye, et al.
Pubblicazione: (2026)

Nonparametric Estimation of Joint Entropy via Partitioned Sample-Spacing
di: Ho, Jungwoo, et al.
Pubblicazione: (2025)

Provable Generalization Bounds for Deep Neural Networks with Momentum-Adaptive Gradient Dropout
di: Safder, Adeel
Pubblicazione: (2025)

Debiased Nonparametric Regression for Statistical Inference and Distributionally Robustness
di: Kato, Masahiro
Pubblicazione: (2024)

Interactive Learning of Single-Index Models via Stochastic Gradient Descent
di: Rajaraman, Nived, et al.
Pubblicazione: (2026)

Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks
di: Hashimoto, Ichiro
Pubblicazione: (2025)

Nonparametric Factor Analysis and Beyond
di: Zheng, Yujia, et al.
Pubblicazione: (2025)

Learning Operators by Regularized Stochastic Gradient Descent with Operator-valued Kernels
di: Yang, Jia-Qi, et al.
Pubblicazione: (2025)

Early Stopping in Contextual Bandits and Inferences
di: Cui, Zihan
Pubblicazione: (2025)

Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression
di: Shi, Haoming, et al.
Pubblicazione: (2026)

Dropout Drops Double Descent
di: Yang, Tian-Le, et al.
Pubblicazione: (2023)

Statistical Inference for Gradient Boosting Regression
di: Fang, Haimo, et al.
Pubblicazione: (2025)