Cover Image

Non-smooth stochastic gradient descent using smoothing functions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Giovannelli, Tommaso, Tan, Jingfu, Vicente, Luis Nunes
Format:	Preprint
Published:	2025
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Stochastic set-valued optimization and its application to robust learning
by: Giovannelli, Tommaso, et al.
Published: (2026)

A stochastic gradient method for trilevel optimization
by: Giovannelli, Tommaso, et al.
Published: (2025)

Worst-case convergence analysis of relatively inexact gradient descent on smooth convex functions
by: Vernimmen, Pierre, et al.
Published: (2025)

Pareto sensitivity, most-changing sub-fronts, and knee solutions
by: Giovannelli, Tommaso, et al.
Published: (2025)

Proximal gradient descent on the smoothed duality gap to solve saddle point problems
by: Fercoq, Olivier
Published: (2025)

Coordinate descent methods beyond smoothness and separability
by: Chorobura, Flavia, et al.
Published: (2024)

Minimizing smooth Kurdyka-Łojasiewicz functions via generalized descent methods: Convergence rate and complexity
by: Ahookhosh, Masoud, et al.
Published: (2025)

Gaussian smoothing gradient descent for minimizing functions (GSmoothGD)
by: Starnes, Andrew, et al.
Published: (2023)

Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game
by: Buck, Kevin, et al.
Published: (2025)

An accelerated proximal PRS-SQP algorithm with dual ascent-descent procedures for smooth composite optimization
by: Jin, Jiachen, et al.
Published: (2025)

Projected gradient methods for nonconvex and stochastic smooth optimization: new complexities and auto-conditioned stepsizes
by: Lan, Guanghui, et al.
Published: (2024)

Nonlinear conjugate gradient for smooth convex functions
by: Karimi, Sahar, et al.
Published: (2021)

New logarithmic step size for stochastic gradient descent
by: Shamaee, M. Soheil, et al.
Published: (2024)

Convergence of linesearch-based generalized conditional gradient methods without smoothness assumptions
by: Yagishita, Shotaro
Published: (2025)

A geometric integration approach to smooth optimisation: Foundations of the discrete gradient method
by: Ehrhardt, Matthias J., et al.
Published: (2018)

Differentiation of inertial methods for optimizing smooth parametric function
by: Godeme, Jean-Jacques
Published: (2025)

A stochastic perturbed augmented Lagrangian method for smooth convex constrained minimization
by: Singh, Nitesh Kumar, et al.
Published: (2025)

A stochastic moving ball approximation method for smooth convex constrained minimization
by: Singh, Nitesh Kumar, et al.
Published: (2024)

A stochastic gradient descent algorithm with random search directions
by: Gbaguidi, Eméric
Published: (2025)

Stochastic smoothing accelerated gradient method for general constrained nonsmooth convex composite optimization
by: Wang, Ruyu, et al.
Published: (2023)

Accelerated Bregman gradient methods for relatively smooth and relatively Lipschitz continuous minimization problems
by: Savchuk, O. S., et al.
Published: (2024)

On the Solvability of Quasi-Regulator Equations in Non-smooth Output Regulation
by: Niu, Zirui, et al.
Published: (2026)

Sequential test sampling for stochastic derivative-free optimization
by: Ding, Anjie, et al.
Published: (2025)

Output Regulation of Linear Systems with Non-periodic Non-smooth Exogenous Signals
by: Niu, Zirui, et al.
Published: (2025)

Variational inequalities and smooth-fit principle for singular stochastic control problems in Hilbert spaces
by: Federico, Salvatore, et al.
Published: (2024)

Implicit regularization of normalized gradient descent
by: Josz, Cédric
Published: (2026)

A Stochastic Newton-type Method for Non-smooth Optimization
by: Pinta, Titus
Published: (2025)

Zeroth-Order Non-smooth Non-convex Optimization via Gaussian Smoothing
by: Paul, Anik Kumar, et al.
Published: (2025)

Convergence of continuous-time stochastic gradient descent with applications to deep neural networks
by: Lugosi, Gabor, et al.
Published: (2024)

Quantum Algorithms for Non-smooth Non-convex Optimization
by: Liu, Chengchang, et al.
Published: (2024)

Adaptive control mechanisms in gradient descent algorithms
by: Iannelli, Andrea
Published: (2025)

Single-loop $\mathcal{O}(ε^{-3})$ stochastic smoothing algorithms for nonsmooth Riemannian optimization
by: Deng, Kangkang, et al.
Published: (2025)

Quantum Hamiltonian Descent for Non-smooth Optimization
by: Leng, Jiaqi, et al.
Published: (2025)

Convergence of Spectral Descent for Non-smooth Optimization
by: Yang, Yixuan, et al.
Published: (2026)

Estimating Sequences with Memory for Minimizing Convex Non-smooth Composite Functions
by: Dosti, Endrit, et al.
Published: (2025)

Frank-Wolfe Algorithms for (L0, L1)-smooth functions
by: Vyguzov, A. A., et al.
Published: (2025)

Mirror descent for constrained stochastic control problems
by: Sethi, Deven, et al.
Published: (2025)

Random Scaling and Momentum for Non-smooth Non-convex Optimization
by: Zhang, Qinzi, et al.
Published: (2024)

Non-convergence to global minimizers for Adam and stochastic gradient descent optimization and constructions of local minimizers in the training of artificial neural networks
by: Jentzen, Arnulf, et al.
Published: (2024)

Verification theorem related to a zero sum stochastic differential game, based on a chain rule for non-smooth functions
by: Ciccarella, Carlo, et al.
Published: (2024)