Cover Image

Learning-rate-free Momentum SGD with Reshuffling Converges in Nonsmooth Nonconvex Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Xiaoyin, Xiao, Nachuan, Liu, Xin, Toh, Kim-Chuan
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Hybrid Subgradient Method for Nonsmooth Nonconvex Bilevel Optimization
by: Xiao, Nachuan, et al.
Published: (2025)

Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization
by: Xiao, Nachuan, et al.
Published: (2023)

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization
by: Xiao, Nachuan, et al.
Published: (2024)

Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees
by: Xiao, Nachuan, et al.
Published: (2023)

Partial Envelope for Optimization Problem with Nonconvex Constraints
by: Hu, Xiaoyin, et al.
Published: (2025)

CDOpt: A Python Package for a Class of Riemannian Optimization
by: Xiao, Nachuan, et al.
Published: (2022)

A Quadratically Convergent Alternating Projection Method for Nonconvex Sets
by: Xiao, Nachuan, et al.
Published: (2025)

A Minimization Approach for Minimax Optimization with Coupled Constraints
by: Hu, Xiaoyin, et al.
Published: (2024)

Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions
by: Zhang, Siyuan, et al.
Published: (2024)

Stochastic Bregman Subgradient Methods for Nonsmooth Nonconvex Optimization Problems
by: Ding, Kuangyu, et al.
Published: (2024)

An Exact Penalty Approach for Equality Constrained Optimization over a Convex Set
by: Xiao, Nachuan, et al.
Published: (2025)

A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimization
by: Qiu, Junwen, et al.
Published: (2023)

Random Reshuffling with Momentum for Nonconvex Problems: Iteration Complexity and Last Iterate Convergence
by: Qiu, Junwen, et al.
Published: (2024)

Nonsmooth Nonconvex-Concave Minimax Optimization: Convergence Criteria and Algorithms
by: Shi, Jinyang, et al.
Published: (2026)

Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization
by: Qin, Zhen, et al.
Published: (2023)

NonOpt: Nonconvex, Nonsmooth Optimizer
by: Curtis, Frank E., et al.
Published: (2025)

Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning
by: Ding, Kuangyu, et al.
Published: (2023)

Deterministic Nonsmooth Nonconvex Optimization
by: Jordan, Michael I., et al.
Published: (2023)

Nonconvex Nonsmooth Multicomposite Optimization and Its Applications to Recurrent Neural Networks
by: Jin, Lingzi, et al.
Published: (2025)

Locally Linear Convergence for Nonsmooth Convex Optimization via Coupled Smoothing and Momentum
by: Baghbadorani, Reza Rahimi, et al.
Published: (2025)

A Smoothing Consensus-Based Optimization Algorithm for Nonsmooth Nonconvex Optimization
by: Wei, Jiazhen, et al.
Published: (2025)

A Smooth Locally Exact Penalty Method for Optimization Problems over Generalized Stiefel Manifolds
by: Jiang, Linshuo, et al.
Published: (2026)

Variational Analysis of a Nonconvex and Nonsmooth Optimization Problem: An Introduction
by: Royset, Johannes O.
Published: (2024)

Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization
by: Khanh, Pham Duy, et al.
Published: (2024)

A Newton-Like Dynamical System for Nonsmooth and Nonconvex Optimization
by: Garrido, Juan Guillermo, et al.
Published: (2024)

A Unified Inexact Stochastic ADMM for Composite Nonconvex and Nonsmooth Optimization
by: Zeng, Yuxuan, et al.
Published: (2024)

Inexact Zeroth-Order Nonsmooth and Nonconvex Stochastic Composite Optimization and Applications
by: Pougkakiotis, Spyridon, et al.
Published: (2025)

An Adaptive Proximal Point Method for Nonsmooth and Nonconvex Optimization on Hadamard Manifolds
by: Amaral, Vitaliano S., et al.
Published: (2025)

On the convergence rates of moment-SOS hierarchies approximation of truncated moment sequences
by: Tran, Hoang Anh, et al.
Published: (2025)

Proximal Dogleg Opportunistic Majorization for Nonconvex and Nonsmooth Optimization
by: Zhou, Yiming, et al.
Published: (2024)

On the Hardness of Meaningful Local Guarantees in Nonsmooth Nonconvex Optimization
by: Kornowski, Guy, et al.
Published: (2024)

An Inexact Preconditioned Zeroth-order Proximal Method for Composite Optimization
by: Liu, Shanglin, et al.
Published: (2024)

Improved Sample Complexity for Private Nonsmooth Nonconvex Optimization
by: Kornowski, Guy, et al.
Published: (2024)

Zeroth-order Gradient and Quasi-Newton Methods for Nonsmooth Nonconvex Stochastic Optimization
by: Marrinan, Luke, et al.
Published: (2023)

Radial Epiderivative Based Fritz John and KKT Conditions in Nonsmooth Nonconvex Optimization
by: Kasimbeyli, Refail, et al.
Published: (2025)

Revisiting Randomized Smoothing: Nonsmooth Nonconvex Optimization Beyond Global Lipschitz Continuity
by: Xia, Jingfan, et al.
Published: (2025)

Private Zeroth-Order Nonsmooth Nonconvex Optimization
by: Zhang, Qinzi, et al.
Published: (2024)

Decentralized Nonsmooth Nonconvex Optimization with Client Sampling
by: Chen, Xinyan, et al.
Published: (2026)

Adaptive Matrix Online Learning through Smoothing with Guarantees for Nonsmooth Nonconvex Optimization
by: Jiang, Ruichen, et al.
Published: (2026)

Zeroth-Order Methods for Stochastic Nonconvex Nonsmooth Composite Optimization
by: Chen, Ziyi, et al.
Published: (2025)