Image de couverture de livre

Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Puyu, Lei, Yunwen, Wang, Di, Ying, Yiming, Zhou, Ding-Xuan
Format:	Preprint
Publié:	2023
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Optimal Rates for Generalization of Gradient Descent for Deep ReLU Classification
par: Li, Yuanfan, et autres
Publié: (2025)

Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks
par: Wang, Puyu, et autres
Publié: (2026)

Stochastic Gradient Descent with Momentum is Algorithmically Stable
par: Lei, Yunwen, et autres
Publié: (2026)

Generalization analysis with deep ReLU networks for metric and similarity learning
par: Zhou, Junyu, et autres
Publié: (2024)

Stability-based Generalization Analysis of Randomized Coordinate Descent for Pairwise Learning
par: Wu, Liang, et autres
Publié: (2025)

Generalization Bounds for Rank-sparse Neural Networks
par: Ledent, Antoine, et autres
Publié: (2025)

On Discriminative Probabilistic Modeling for Self-Supervised Representation Learning
par: Wang, Bokun, et autres
Publié: (2024)

Beyond Cross-Validation: Adaptive Parameter Selection for Kernel-Based Gradient Descents
par: Liu, Xiaotong, et autres
Publié: (2026)

Towards Initialization-dependent and Non-vacuous Generalization Bounds for Overparameterized Shallow Neural Networks
par: Lei, Yunwen, et autres
Publié: (2026)

Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems trained with Gradient Descent
par: Buskulic, Nathan, et autres
Publié: (2024)

Distributed Gradient Descent for Functional Learning
par: Yu, Zhan, et autres
Publié: (2023)

Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks
par: Ma, Wenquan, et autres
Publié: (2026)

Stochastic Gradient Descent for Two-layer Neural Networks
par: Cao, Dinghao, et autres
Publié: (2024)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
par: Xu, Xianliang, et autres
Publié: (2024)

Fine-grained Analysis of Non-parametric Estimation for Pairwise Learning
par: Zhou, Junyu, et autres
Publié: (2023)

How Does Gradient Descent Learn Features -- A Local Analysis for Regularized Two-Layer Neural Networks
par: Zhou, Mo, et autres
Publié: (2024)

Generalization Guarantees on Data-Driven Tuning of Gradient Descent with Langevin Updates
par: Goyal, Saumya, et autres
Publié: (2026)

Generalization and Optimization of SGD with Lookahead
par: Li, Kangcheng, et autres
Publié: (2025)

Towards Understanding Generalization in DP-GD: A Case Study in Training Two-Layer CNNs
par: Shi, Zhongjie, et autres
Publié: (2025)

Statistical Guarantees for High-Dimensional Stochastic Gradient Descent
par: Li, Jiaqi, et autres
Publié: (2025)

Learning Theory of the SVRG: Generalization and Convergence Analysis
par: Lei, Yunwen, et autres
Publié: (2026)

Solving Inverse Problems with Deep Linear Neural Networks: Global Convergence Guarantees for Gradient Descent with Weight Decay
par: Laus, Hannah, et autres
Publié: (2025)

Gradient Flow Convergence Guarantee for General Neural Network Architectures
par: Jakhmola, Yash
Publié: (2025)

Variational Stochastic Gradient Descent for Deep Neural Networks
par: Chen, Haotian, et autres
Publié: (2024)

Classification with Deep Neural Networks and Logistic Loss
par: Zhang, Zihan, et autres
Publié: (2023)

Do Neural Networks Need Gradient Descent to Generalize? A Theoretical Study
par: Alexander, Yotam, et autres
Publié: (2025)

Gradient Manipulation in Distributed Stochastic Gradient Descent with Strategic Agents: Truthful Incentives with Convergence Guarantees
par: Chen, Ziqin, et autres
Publié: (2026)

Optimal Convergence Rates of Deep Neural Network Classifiers
par: Zhang, Zihan, et autres
Publié: (2025)

A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent
par: Wang, Mingze, et autres
Publié: (2023)

Hybrid Coordinate Descent for Efficient Neural Network Learning Using Line Search and Gradient Descent
par: Hsiao, Yen-Che, et autres
Publié: (2024)

Convergence Analysis of Natural Gradient Descent for Over-parameterized Physics-Informed Neural Networks
par: Xu, Xianliang, et autres
Publié: (2024)

Randomized Pairwise Learning with Adaptive Sampling: A PAC-Bayes Analysis
par: Zhou, Sijia, et autres
Publié: (2025)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
par: Taheri, Hossein, et autres
Publié: (2025)

The Double Descent Behavior in Two Layer Neural Network for Binary Classification
par: Abeykoon, Chathurika S, et autres
Publié: (2025)

Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression
par: Yang, Yingzhen, et autres
Publié: (2024)

On Multi-Stage Loss Dynamics in Neural Networks: Mechanisms of Plateau and Descent Stages
par: Chen, Zheng-An, et autres
Publié: (2024)

Layer-diverse Negative Sampling for Graph Neural Networks
par: Duan, Wei, et autres
Publié: (2024)

Minibatch and Local SGD: Algorithmic Stability and Linear Speedup in Generalization
par: Lei, Yunwen, et autres
Publié: (2023)

Gradient Descent Algorithm Survey
par: Fucheng, Deng, et autres
Publié: (2025)

Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
par: Nichani, Eshaan, et autres
Publié: (2023)