Saved in:
| Main Authors: | Hu, Yukuan, Yin, Junlei, Gao, Xingyu, Liu, Xin, Song, Haifeng |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.02934 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Learning complexity of gradient descent and conjugate gradient algorithms
by: Jiao, Xianqi, et al.
Published: (2024)
by: Jiao, Xianqi, et al.
Published: (2024)
The duality structure gradient descent algorithm: analysis and applications to neural networks
by: Flynn, Thomas
Published: (2017)
by: Flynn, Thomas
Published: (2017)
Adaptive control mechanisms in gradient descent algorithms
by: Iannelli, Andrea
Published: (2025)
by: Iannelli, Andrea
Published: (2025)
A relax-fix-and-exclude algorithm for an MINLP problem with multilinear interpolations
by: Pacheco, Bruno Machado, et al.
Published: (2025)
by: Pacheco, Bruno Machado, et al.
Published: (2025)
A stochastic gradient descent algorithm with random search directions
by: Gbaguidi, Eméric
Published: (2025)
by: Gbaguidi, Eméric
Published: (2025)
Implicit regularization of normalized gradient descent
by: Josz, Cédric
Published: (2026)
by: Josz, Cédric
Published: (2026)
Constrained dynamics for searching saddle points on general Riemannian manifolds
by: Hu, Yukuan, et al.
Published: (2026)
by: Hu, Yukuan, et al.
Published: (2026)
Extended alternating structure-adapted proximal gradient algorithm for nonconvex nonsmooth problems
by: Gao, Ying, et al.
Published: (2024)
by: Gao, Ying, et al.
Published: (2024)
Reachability of gradient descent
by: Josz, Cédric, et al.
Published: (2025)
by: Josz, Cédric, et al.
Published: (2025)
Projected proximal gradient trust-region algorithm for nonsmooth optimization
by: Dao, Minh N., et al.
Published: (2025)
by: Dao, Minh N., et al.
Published: (2025)
Non-smooth stochastic gradient descent using smoothing functions
by: Giovannelli, Tommaso, et al.
Published: (2025)
by: Giovannelli, Tommaso, et al.
Published: (2025)
Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks
by: An, Jing, et al.
Published: (2023)
by: An, Jing, et al.
Published: (2023)
New logarithmic step size for stochastic gradient descent
by: Shamaee, M. Soheil, et al.
Published: (2024)
by: Shamaee, M. Soheil, et al.
Published: (2024)
On the convergence analysis of the decentralized projected gradient descent method
by: Choi, Woocheol, et al.
Published: (2023)
by: Choi, Woocheol, et al.
Published: (2023)
Projected gradient descent accumulates at Bouligand stationary points
by: Olikier, Guillaume, et al.
Published: (2024)
by: Olikier, Guillaume, et al.
Published: (2024)
Riemannian coordinate descent algorithms on matrix manifolds
by: Han, Andi, et al.
Published: (2024)
by: Han, Andi, et al.
Published: (2024)
Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game
by: Buck, Kevin, et al.
Published: (2025)
by: Buck, Kevin, et al.
Published: (2025)
Gradient extremals, talwegs, valleys, and directional alignment for generic gradient descent
by: Bégout, Pascal, et al.
Published: (2026)
by: Bégout, Pascal, et al.
Published: (2026)
A two-stage search framework for constrained multi-gradient descent
by: Lei, Yuan-Zheng, et al.
Published: (2025)
by: Lei, Yuan-Zheng, et al.
Published: (2025)
Global convergence of gradient descent for phase retrieval
by: Fougereux, Théodore, et al.
Published: (2024)
by: Fougereux, Théodore, et al.
Published: (2024)
An overview of the fractional-order gradient descent method and its applications
by: Ferreira, Higor V. M., et al.
Published: (2026)
by: Ferreira, Higor V. M., et al.
Published: (2026)
A nonmonotone extrapolated proximal gradient-subgradient algorithm beyond global Lipschitz gradient continuity
by: Yang, Lei, et al.
Published: (2025)
by: Yang, Lei, et al.
Published: (2025)
A global Barzilai and Borwein's gradient normalization descent method for multiobjective optimization
by: Yang, Yingxue
Published: (2024)
by: Yang, Yingxue
Published: (2024)
Proximal gradient descent on the smoothed duality gap to solve saddle point problems
by: Fercoq, Olivier
Published: (2025)
by: Fercoq, Olivier
Published: (2025)
A short proof of near-linear convergence of adaptive gradient descent under fourth-order growth and convexity
by: Davis, Damek, et al.
Published: (2026)
by: Davis, Damek, et al.
Published: (2026)
Introduction: Swarm-based gradient descent for non convex optimization
by: Tikko, Janina
Published: (2024)
by: Tikko, Janina
Published: (2024)
On the global convergence of gradient descent for wide shallow models with bounded nonlinearities
by: Petit, Romain, et al.
Published: (2026)
by: Petit, Romain, et al.
Published: (2026)
Worst-case convergence analysis of relatively inexact gradient descent on smooth convex functions
by: Vernimmen, Pierre, et al.
Published: (2025)
by: Vernimmen, Pierre, et al.
Published: (2025)
Coordinate projected gradient descent minimization and its application to orthogonal nonnegative matrix factorization
by: Chorobura, Flavia, et al.
Published: (2025)
by: Chorobura, Flavia, et al.
Published: (2025)
Long-time dynamics and universality of nonconvex gradient descent
by: Han, Qiyang
Published: (2025)
by: Han, Qiyang
Published: (2025)
A perturbed preconditioned gradient descent method for the unconstrained minimization of composite objectives
by: Park, Jea-Hyun, et al.
Published: (2025)
by: Park, Jea-Hyun, et al.
Published: (2025)
On the stability of gradient descent with second order dynamics for time-varying cost functions
by: Gibson, Travis E., et al.
Published: (2024)
by: Gibson, Travis E., et al.
Published: (2024)
Convergence of continuous-time stochastic gradient descent with applications to deep neural networks
by: Lugosi, Gabor, et al.
Published: (2024)
by: Lugosi, Gabor, et al.
Published: (2024)
Non-ergodic linear convergence property of the delayed gradient descent under the strongly convexity and the Polyak-Łojasiewicz condition
by: Choi, Hyung Jun, et al.
Published: (2023)
by: Choi, Hyung Jun, et al.
Published: (2023)
Proximal gradient-type method with generalized distance and convergence analysis without global descent lemma
by: Yagishita, Shotaro, et al.
Published: (2025)
by: Yagishita, Shotaro, et al.
Published: (2025)
A consensus-based optimization method for nonsmooth nonconvex programs with approximated gradient descent scheme
by: Wei, Jiazhen, et al.
Published: (2025)
by: Wei, Jiazhen, et al.
Published: (2025)
Alternatives with stronger convergence than coordinate-descent iterative LMI algorithms
by: Simon, Emile, et al.
Published: (2011)
by: Simon, Emile, et al.
Published: (2011)
Research on the descent direction of prediction correction algorithms for pseudo-convex/convex optimization problems
by: Li, Ting, et al.
Published: (2025)
by: Li, Ting, et al.
Published: (2025)
When majority rules, minority loses: bias amplification of gradient descent
by: Bachoc, François, et al.
Published: (2025)
by: Bachoc, François, et al.
Published: (2025)
Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression
by: Lok, Jackie, et al.
Published: (2024)
by: Lok, Jackie, et al.
Published: (2024)
Similar Items
-
Learning complexity of gradient descent and conjugate gradient algorithms
by: Jiao, Xianqi, et al.
Published: (2024) -
The duality structure gradient descent algorithm: analysis and applications to neural networks
by: Flynn, Thomas
Published: (2017) -
Adaptive control mechanisms in gradient descent algorithms
by: Iannelli, Andrea
Published: (2025) -
A relax-fix-and-exclude algorithm for an MINLP problem with multilinear interpolations
by: Pacheco, Bruno Machado, et al.
Published: (2025) -
A stochastic gradient descent algorithm with random search directions
by: Gbaguidi, Eméric
Published: (2025)