Cover Image

Implicit regularization of normalized gradient descent

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Josz, Cédric
Format:	Preprint
Published:	2026
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reachability of gradient descent
by: Josz, Cédric, et al.
Published: (2025)

Global convergence of gradient descent for phase retrieval
by: Fougereux, Théodore, et al.
Published: (2024)

Lyapunov stability of the Euler method
by: Josz, Cédric
Published: (2025)

Subdifferentiation with symmetry
by: Josz, Cédric
Published: (2025)

On the geometry of flat minima
by: Josz, Cédric
Published: (2025)

Convergence of the momentum method for semialgebraic functions with locally Lipschitz gradients
by: Josz, Cédric, et al.
Published: (2023)

Global convergence of the gradient method for functions definable in o-minimal structures
by: Josz, Cédric
Published: (2023)

Nonsmooth rank-one symmetric matrix factorization landscape
by: Josz, Cédric, et al.
Published: (2024)

Singular perturbation in heavy ball dynamics
by: Josz, Cedric, et al.
Published: (2024)

Proximal random reshuffling under local Lipschitz continuity
by: Josz, Cedric, et al.
Published: (2024)

A global Barzilai and Borwein's gradient normalization descent method for multiobjective optimization
by: Yang, Yingxue
Published: (2024)

Computing Kurdyka-Łojasiewicz exponents via composition and symmetry
by: Josz, Cédric, et al.
Published: (2026)

Adaptive control mechanisms in gradient descent algorithms
by: Iannelli, Andrea
Published: (2025)

On the convergence analysis of the decentralized projected gradient descent method
by: Choi, Woocheol, et al.
Published: (2023)

Steepest geometric descent for regularized quasiconvex functions
by: Daniilidis, Aris, et al.
Published: (2023)

Learning complexity of gradient descent and conjugate gradient algorithms
by: Jiao, Xianqi, et al.
Published: (2024)

Non-smooth stochastic gradient descent using smoothing functions
by: Giovannelli, Tommaso, et al.
Published: (2025)

Gradient extremals, talwegs, valleys, and directional alignment for generic gradient descent
by: Bégout, Pascal, et al.
Published: (2026)

Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game
by: Buck, Kevin, et al.
Published: (2025)

A two-stage search framework for constrained multi-gradient descent
by: Lei, Yuan-Zheng, et al.
Published: (2025)

Proximal gradient descent on the smoothed duality gap to solve saddle point problems
by: Fercoq, Olivier
Published: (2025)

A theory on the absence of spurious solutions for nonconvex and nonsmooth optimization
by: Josz, Cedric, et al.
Published: (2018)

New logarithmic step size for stochastic gradient descent
by: Shamaee, M. Soheil, et al.
Published: (2024)

Worst-case convergence analysis of relatively inexact gradient descent on smooth convex functions
by: Vernimmen, Pierre, et al.
Published: (2025)

Coordinate projected gradient descent minimization and its application to orthogonal nonnegative matrix factorization
by: Chorobura, Flavia, et al.
Published: (2025)

Proximal gradient-type method with generalized distance and convergence analysis without global descent lemma
by: Yagishita, Shotaro, et al.
Published: (2025)

A consensus-based optimization method for nonsmooth nonconvex programs with approximated gradient descent scheme
by: Wei, Jiazhen, et al.
Published: (2025)

An overview of the fractional-order gradient descent method and its applications
by: Ferreira, Higor V. M., et al.
Published: (2026)

Implicit predictors in regularized data-driven predictive control
by: Klädtke, Manuel, et al.
Published: (2023)

Iterative regularization in classification via hinge loss diagonal descent
by: Apidopoulos, Vassilis, et al.
Published: (2022)

On the global convergence of gradient descent for wide shallow models with bounded nonlinearities
by: Petit, Romain, et al.
Published: (2026)

The duality structure gradient descent algorithm: analysis and applications to neural networks
by: Flynn, Thomas
Published: (2017)

Directional descent
by: Young, Andrew J.
Published: (2024)

Introduction: Swarm-based gradient descent for non convex optimization
by: Tikko, Janina
Published: (2024)

A stochastic gradient descent algorithm with random search directions
by: Gbaguidi, Eméric
Published: (2025)

A perturbed preconditioned gradient descent method for the unconstrained minimization of composite objectives
by: Park, Jea-Hyun, et al.
Published: (2025)

On the stability of gradient descent with second order dynamics for time-varying cost functions
by: Gibson, Travis E., et al.
Published: (2024)

Convergence of continuous-time stochastic gradient descent with applications to deep neural networks
by: Lugosi, Gabor, et al.
Published: (2024)

On the complexity of proximal gradient and proximal gradient-Newton-CG methods for \(\ell_1\)-regularized Optimization
by: Zhu, Hong
Published: (2025)

Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression
by: Lok, Jackie, et al.
Published: (2024)