Last-Iterate Complexity of SGD for Convex and Smooth Stochastic Problems
Fuente:
arXiv
Saved in:
| Main Authors: | Garrigos, Guillaume, Cortild, Daniel, Ketels, Lucas, Peypouquet, Juan |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysis
by: Cortild, Daniel, et al.
Published: (2025)
by: Cortild, Daniel, et al.
Published: (2025)
Krasnoselskii-Mann Iterations: Inertia, Perturbations and Approximation
by: Cortild, Daniel, et al.
Published: (2024)
by: Cortild, Daniel, et al.
Published: (2024)
Adaptive Accelerated Gradient Method for Smooth Convex Optimization
by: Wang, Zepeng, et al.
Published: (2025)
by: Wang, Zepeng, et al.
Published: (2025)
Global Optimization Algorithm through High-Resolution Sampling
by: Cortild, Daniel, et al.
Published: (2024)
by: Cortild, Daniel, et al.
Published: (2024)
Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
by: Attia, Amit, et al.
Published: (2025)
by: Attia, Amit, et al.
Published: (2025)
Accelerated Backward Forward Method for Convex Optimization
by: Wang, Zepeng, et al.
Published: (2026)
by: Wang, Zepeng, et al.
Published: (2026)
Last Iterate Convergence of AdaGrad-Norm for Convex Non-Smooth Optimization
by: Preobrazhenskaia, Margarita, et al.
Published: (2026)
by: Preobrazhenskaia, Margarita, et al.
Published: (2026)
Online Inventory Problems: Beyond the i.i.d. Setting with Online Convex Optimization
by: Hihat, Massil, et al.
Published: (2023)
by: Hihat, Massil, et al.
Published: (2023)
Stochastic Krasnoselskii-Mann Iterations: Convergence without Uniformly Bounded Variance
by: Cortild, Daniel, et al.
Published: (2026)
by: Cortild, Daniel, et al.
Published: (2026)
Convergence of Clipped SGD on Convex $(L_0,L_1)$-Smooth Functions
by: Gaash, Ofir, et al.
Published: (2025)
by: Gaash, Ofir, et al.
Published: (2025)
Stochastic Decentralized Optimization of Non-Smooth Convex and Convex-Concave Problems over Time-Varying Networks
by: Divilkovskiy, Maxim, et al.
Published: (2025)
by: Divilkovskiy, Maxim, et al.
Published: (2025)
Optimal Primal-Dual Algorithm with Last iterate Convergence Guarantees for Stochastic Convex Optimization Problems
by: Boob, Digvijay, et al.
Published: (2024)
by: Boob, Digvijay, et al.
Published: (2024)
Quadratic Objective Perturbation: Curvature-Based Differential Privacy
by: Cortild, Daniel, et al.
Published: (2026)
by: Cortild, Daniel, et al.
Published: (2026)
SLowcal-SGD: Slow Query Points Improve Local-SGD for Stochastic Convex Optimization
by: Dahan, Tehila, et al.
Published: (2023)
by: Dahan, Tehila, et al.
Published: (2023)
Convergence Rate Analysis for Monotone Accelerated Proximal Gradient Method
by: Wang, Zepeng, et al.
Published: (2025)
by: Wang, Zepeng, et al.
Published: (2025)
Accelerated Gradient Methods via Inertial Systems with Hessian-driven Damping
by: Wang, Zepeng, et al.
Published: (2025)
by: Wang, Zepeng, et al.
Published: (2025)
Fast convex optimization via inertial systems with asymptotically vanishing viscosity and Hessian-driven damping
by: Wang, Zepeng, et al.
Published: (2025)
by: Wang, Zepeng, et al.
Published: (2025)
Muon Does Not Converge on Convex Lipschitz Functions
by: Parshakova, Tetiana, et al.
Published: (2026)
by: Parshakova, Tetiana, et al.
Published: (2026)
Distributed Stochastic Optimization for Non-Smooth and Weakly Convex Problems under Heavy-Tailed Noise
by: Hu, Jun, et al.
Published: (2025)
by: Hu, Jun, et al.
Published: (2025)
Last-Iterate Convergence of Randomized Kaczmarz and SGD with Greedy Step Size
by: Dereziński, Michał, et al.
Published: (2026)
by: Dereziński, Michał, et al.
Published: (2026)
Provable Complexity Improvement of AdaGrad over SGD: Upper and Lower Bounds in Stochastic Non-Convex Optimization
by: Jiang, Ruichen, et al.
Published: (2024)
by: Jiang, Ruichen, et al.
Published: (2024)
Handbook of Convergence Theorems for (Stochastic) Gradient Methods
by: Garrigos, Guillaume, et al.
Published: (2023)
by: Garrigos, Guillaume, et al.
Published: (2023)
Stochastic Non-Smooth Non-Convex Optimization with Decision-Dependent Distributions
by: Liu, Chengchang, et al.
Published: (2026)
by: Liu, Chengchang, et al.
Published: (2026)
Convergence Rate of the Last Iterate of Stochastic Proximal Algorithms
by: Vaidyan, Kevin Kurian Thomas, et al.
Published: (2026)
by: Vaidyan, Kevin Kurian Thomas, et al.
Published: (2026)
Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods
by: Liu, Zijian, et al.
Published: (2023)
by: Liu, Zijian, et al.
Published: (2023)
Last Iterate Convergence of Popov Method for Non-monotone Stochastic Variational Inequalities
by: Vankov, Daniil, et al.
Published: (2023)
by: Vankov, Daniil, et al.
Published: (2023)
Improved Iteration Complexity in Black-Box Optimization Problems under Higher Order Smoothness Function Condition
by: Lobanov, Aleksandr
Published: (2024)
by: Lobanov, Aleksandr
Published: (2024)
Asymptotic behavior of penalty dynamics for constrained variational inequalities
by: Qu, Siqi, et al.
Published: (2025)
by: Qu, Siqi, et al.
Published: (2025)
Towards faster first order methods: A continuous-time model to interpolate between speed and function value restart
by: Maulén, Juan José, et al.
Published: (2025)
by: Maulén, Juan José, et al.
Published: (2025)
Convergence of Clipped-SGD for Convex $(L_0,L_1)$-Smooth Optimization with Heavy-Tailed Noise
by: Chezhegov, Savelii, et al.
Published: (2025)
by: Chezhegov, Savelii, et al.
Published: (2025)
Improved Last-Iterate Convergence of Shuffling Gradient Methods for Nonsmooth Convex Optimization
by: Liu, Zijian, et al.
Published: (2025)
by: Liu, Zijian, et al.
Published: (2025)
Power of Generalized Smoothness in Stochastic Convex Optimization: First- and Zero-Order Algorithms
by: Lobanov, Aleksandr, et al.
Published: (2025)
by: Lobanov, Aleksandr, et al.
Published: (2025)
Stochastic Non-Smooth Convex Optimization with Unbounded Gradients
by: Kovalev, Dmitry
Published: (2026)
by: Kovalev, Dmitry
Published: (2026)
Random Reshuffling with Momentum for Nonconvex Problems: Iteration Complexity and Last Iterate Convergence
by: Qiu, Junwen, et al.
Published: (2024)
by: Qiu, Junwen, et al.
Published: (2024)
Regularization methods for solving hierarchical variational inequalities with complexity guarantees
by: Cortild, Daniel, et al.
Published: (2025)
by: Cortild, Daniel, et al.
Published: (2025)
Adaptive Variant of Frank-Wolfe Method for Relative Smooth Convex Optimization Problems
by: Vyguzov, Alexander, et al.
Published: (2024)
by: Vyguzov, Alexander, et al.
Published: (2024)
Avoiding Bias in Clipped SGD for Overparameterized Models under Generalized Smoothness
by: Lobanov, Aleksandr, et al.
Published: (2026)
by: Lobanov, Aleksandr, et al.
Published: (2026)
A Block-Alternating Iterative Approach for a Class of Non-Convex Optimization Problems
by: Li, Anran, et al.
Published: (2026)
by: Li, Anran, et al.
Published: (2026)
Last-Iterate Convergence of Anchored Gradient Descent
by: Cai, Yang, et al.
Published: (2026)
by: Cai, Yang, et al.
Published: (2026)
Stochastic Fleet Size and Mix Consistent Vehicle Routing Problem for Last Mile Delivery
by: Beatrici, Paolo, et al.
Published: (2025)
by: Beatrici, Paolo, et al.
Published: (2025)
Similar Items
-
Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysis
by: Cortild, Daniel, et al.
Published: (2025) -
Krasnoselskii-Mann Iterations: Inertia, Perturbations and Approximation
by: Cortild, Daniel, et al.
Published: (2024) -
Adaptive Accelerated Gradient Method for Smooth Convex Optimization
by: Wang, Zepeng, et al.
Published: (2025) -
Global Optimization Algorithm through High-Resolution Sampling
by: Cortild, Daniel, et al.
Published: (2024) -
Fast Last-Iterate Convergence of SGD in the Smooth Interpolation Regime
by: Attia, Amit, et al.
Published: (2025)