Image de couverture de livre

Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yang, Yingzhen, Li, Ping
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Information Theory
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Sharp Generalization for Nonparametric Regression in Interpolation Space by Over-Parameterized Neural Networks Trained with Preconditioned Gradient Descent and Early Stopping
par: Yang, Yingzhen, et autres
Publié: (2024)

Gradient Descent with Projection Finds Over-Parameterized Neural Networks for Learning Low-Degree Polynomials with Nearly Minimax Optimal Rate
par: Yang, Yingzhen, et autres
Publié: (2026)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
par: Taheri, Hossein, et autres
Publié: (2025)

Non-Coherent Over-the-Air Decentralized Gradient Descent
par: Michelusi, Nicolo'
Publié: (2022)

Global Convergence Analysis of Vanilla Gradient Descent for Asymmetric Matrix Completion
par: Zhang, Xu, et autres
Publié: (2025)

How Transformers Learn Causal Structure with Gradient Descent
par: Nichani, Eshaan, et autres
Publié: (2024)

Standard Transformers Achieve the Minimax Rate in Nonparametric Regression with $C^{s,λ}$ Targets
par: Lai, Yanming, et autres
Publié: (2026)

Scaled Gradient Descent for Ill-Conditioned Low-Rank Matrix Recovery with Optimal Sampling Complexity
par: Li, Zhenxuan, et autres
Publié: (2026)

Rank-1 Matrix Completion with Gradient Descent and Small Random Initialization
par: Kim, Daesung, et autres
Publié: (2022)

A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent
par: Wang, Shuche, et autres
Publié: (2024)

Guaranteed Nonconvex Low-Rank Tensor Estimation via Scaled Gradient Descent
par: Wu, Tong
Publié: (2025)

Mutual Information Multinomial Estimation
par: Chen, Yanzhi, et autres
Publié: (2024)

Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods
par: Taheri, Hossein, et autres
Publié: (2024)

Least Squares Regression Can Exhibit Under-Parameterized Double Descent
par: Li, Xinyue, et autres
Publié: (2023)

Projective Proximal Gradient Descent for A Class of Nonconvex Nonsmooth Optimization Problems: Fast Convergence Without Kurdyka-Lojasiewicz (KL) Property
par: Yang, Yingzhen, et autres
Publié: (2023)

Stochastic Gradient Descent for Nonparametric Additive Regression
par: Chen, Xin, et autres
Publié: (2024)

Efficient Gradient Estimation for Parameterized Quantum Systems with Lie Algebraic Symmetries
par: Heidari, Mohsen, et autres
Publié: (2024)

Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization
par: Shen, Wei, et autres
Publié: (2023)

Generating Rectifiable Measures through Neural Networks
par: Riegler, Erwin, et autres
Publié: (2024)

Information-Theoretic Generalization Bounds for Deep Neural Networks
par: He, Haiyun, et autres
Publié: (2024)

Prioritizing Gradient Sign Over Modulus: An Importance-Aware Framework for Wireless Federated Learning
par: Yue, Yiyang, et autres
Publié: (2026)

Generalization Error of Graph Neural Networks in the Mean-field Regime
par: Aminian, Gholamali, et autres
Publié: (2024)

Locally Regularized Sparse Graph by Fast Proximal Gradient Descent
par: Sun, Dongfang, et autres
Publié: (2024)

Multi-head Transformers Provably Learn Symbolic Multi-step Reasoning via Gradient Descent
par: Yang, Tong, et autres
Publié: (2025)

Over-the-Air Edge Inference via End-to-End Metasurfaces-Integrated Artificial Neural Networks
par: Stylianopoulos, Kyriakos, et autres
Publié: (2025)

Joint Constellation Shaping Using Gradient Descent Approach for MU-MIMO Broadcast Channel
par: Vaillant, Maxime, et autres
Publié: (2024)

Distributed Nonparametric Estimation: from Sparse to Dense Samples per Terminal
par: Yuan, Deheng, et autres
Publié: (2025)

Inference for Deep Neural Network Estimators in Generalized Nonparametric Models
par: Meng, Xuran, et autres
Publié: (2025)

Semi-Supervised Learning with Noisy Proxy Covariates: Generalization Bounds and Distribution Regression
par: Kim, Kwangho, et autres
Publié: (2026)

Why Does Stochastic Gradient Descent Slow Down in Low-Precision Training?
par: Yun, Vincent-Daniel
Publié: (2025)

Frame Quantization of Neural Networks
par: Czaja, Wojciech, et autres
Publié: (2024)

Efficient Sampling with Discrete Diffusion Models: Sharp and Adaptive Guarantees
par: Dmitriev, Daniil, et autres
Publié: (2026)

Minimax optimal submatrix detection: Sharp non-asymptotic rates
par: Knight, Parker, et autres
Publié: (2026)

Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization
par: Zhang, Gavin, et autres
Publié: (2025)

Asymptotic Behavior of Multi--Task Learning: Implicit Regularization and Double Descent Effects
par: Alrashdi, Ayed M., et autres
Publié: (2026)

Klein Model for Hyperbolic Neural Networks
par: Mao, Yidan, et autres
Publié: (2024)

Topological Neural Networks over the Air
par: Fiorellino, Simone, et autres
Publié: (2025)

Sharp analysis of out-of-distribution error for "importance-weighted" estimators in the overparameterized regime
par: Lai, Kuo-Wei, et autres
Publié: (2024)

Order Optimal Regret Bounds for Sharpe Ratio Optimization under Thompson Sampling
par: Shah, Mohammad Taha, et autres
Publié: (2025)

Graph Attention Network for Node Regression on Random Geometric Graphs with Erdős--Rényi contamination
par: Laha, Somak, et autres
Publié: (2026)