Image de couverture de livre

On the stability of gradient descent with second order dynamics for time-varying cost functions

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Gibson, Travis E., Acharya, Sawal, Parashar, Anjali, Gaudio, Joseph E., Annaswamy, Anurdha M.
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Optimization and Control
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Regret Analysis: a control perspective
par: Gibson, Travis E., et autres
Publié: (2025)

Long-time dynamics and universality of nonconvex gradient descent
par: Han, Qiyang
Publié: (2025)

Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression
par: Lok, Jackie, et autres
Publié: (2024)

Convergence of continuous-time stochastic gradient descent with applications to deep neural networks
par: Lugosi, Gabor, et autres
Publié: (2024)

New logarithmic step size for stochastic gradient descent
par: Shamaee, M. Soheil, et autres
Publié: (2024)

A short proof of near-linear convergence of adaptive gradient descent under fourth-order growth and convexity
par: Davis, Damek, et autres
Publié: (2026)

On the global convergence of gradient descent for wide shallow models with bounded nonlinearities
par: Petit, Romain, et autres
Publié: (2026)

The duality structure gradient descent algorithm: analysis and applications to neural networks
par: Flynn, Thomas
Publié: (2017)

A stochastic gradient descent algorithm with random search directions
par: Gbaguidi, Eméric
Publié: (2025)

Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
par: An, Jing, et autres
Publié: (2025)

Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks
par: An, Jing, et autres
Publié: (2023)

Physics-Informed Graph Neural Network for Dynamic Reconfiguration of Power Systems
par: Authier, Jules, et autres
Publié: (2023)

A second-order-like optimizer with adaptive gradient scaling for deep learning
par: Bolte, Jérôme, et autres
Publié: (2024)

Global convergence of gradient descent for phase retrieval
par: Fougereux, Théodore, et autres
Publié: (2024)

When majority rules, minority loses: bias amplification of gradient descent
par: Bachoc, François, et autres
Publié: (2025)

Precise gradient descent training dynamics for finite-width multi-layer neural networks
par: Han, Qiyang, et autres
Publié: (2025)

Non-convergence to global minimizers for Adam and stochastic gradient descent optimization and constructions of local minimizers in the training of artificial neural networks
par: Jentzen, Arnulf, et autres
Publié: (2024)

An accelerated first-order regularized momentum descent ascent algorithm for stochastic nonconvex-concave minimax problems
par: Zhang, Huiling, et autres
Publié: (2023)

Manifold constrained steepest descent
par: Yang, Kaiwei, et autres
Publié: (2026)

Federated Learning Forecasting for Strengthening Grid Reliability and Enabling Markets for Resilience
par: Pereira, Lucas, et autres
Publié: (2024)

Flattened one-bit stochastic gradient descent: compressed distributed optimization with controlled variance
par: Stollenwerk, Alexander, et autres
Publié: (2024)

Convergence of flow-based generative models via proximal gradient descent in Wasserstein space
par: Cheng, Xiuyuan, et autres
Publié: (2023)

Generalized EXTRA stochastic gradient Langevin dynamics
par: Gurbuzbalaban, Mert, et autres
Publié: (2024)

Learning mirror maps in policy mirror descent
par: Alfano, Carlo, et autres
Publié: (2024)

Riemannian coordinate descent algorithms on matrix manifolds
par: Han, Andi, et autres
Publié: (2024)

Error bounds for particle gradient descent, and extensions of the log-Sobolev and Talagrand inequalities
par: Caprio, Rocco, et autres
Publié: (2024)

Gradient descent in matrix factorization: Understanding large initialization
par: Chen, Hengchao, et autres
Publié: (2023)

Stochastic Inverse Problem: stability, regularization and Wasserstein gradient flow
par: Li, Qin, et autres
Publié: (2024)

Iterative regularization in classification via hinge loss diagonal descent
par: Apidopoulos, Vassilis, et autres
Publié: (2022)

On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem
par: Ding, Kuangyu, et autres
Publié: (2025)

$\ell_1$-norm rank-one symmetric matrix factorization has no spurious second-order stationary points
par: Guan, Jiewen, et autres
Publié: (2024)

The Mixing method: low-rank coordinate descent for semidefinite programming with diagonal constraints
par: Wang, Po-Wei, et autres
Publié: (2017)

Fuzzy hyperparameters update in a second order optimization
par: Bensadok, Abdelaziz, et autres
Publié: (2024)

Linear convergence of proximal descent schemes on the Wasserstein space
par: Lascu, Razvan-Andrei, et autres
Publié: (2024)

Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses
par: Dereich, Steffen, et autres
Publié: (2024)

The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks
par: Schechtman, Sholom, et autres
Publié: (2025)

Almost sure convergence rates of stochastic gradient methods under gradient domination
par: Weissmann, Simon, et autres
Publié: (2024)

Frugality in second-order optimization: floating-point approximations for Newton's method
par: Carrino, Giuseppe, et autres
Publié: (2025)

A block-coordinate descent framework for non-convex composite optimization. Application to sparse precision matrix estimation
par: Lauga, Guillaume
Publié: (2026)

Fast Spawn\&Prune (FS\&P): Global convergence of stochastic conic particle gradient descent via birth/death process
par: De Castro, Yohann, et autres
Publié: (2026)