Imagen de Portada

Optimal Local Convergence Rates of Stochastic First-Order Methods under Local $α$-PL

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Masiha, Saeed, Salehkaleybar, Saber, He, Niao, Kiyavash, Negar, Thiran, Patrick
Formato:	Preprint
Publicado:	2024
Materias:	Optimization and Control Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Efficiently Escaping Saddle Points for Policy Optimization
por: Khorasani, Sadegh, et al.
Publicado: (2023)

Superquantile-Gibbs Relaxation for Minima-selection in Bilevel Optimization
por: Masiha, Saeed, et al.
Publicado: (2025)

Select-then-differentiate: Solving Bilevel Optimization with Manifold Lower-level Solution Sets
por: Masiha, Saeed, et al.
Publicado: (2026)

Zeroth-Order Stackelberg Control in Combinatorial Congestion Games
por: Masiha, Saeed, et al.
Publicado: (2026)

Biased Stochastic First-Order Methods for Conditional Stochastic Optimization and Applications in Meta Learning
por: Hu, Yifan, et al.
Publicado: (2020)

A Schrödinger Eigenfunction Method for Long-Horizon Stochastic Optimal Control
por: Claeys, Louis, et al.
Publicado: (2026)

Near-Optimal Experiment Design in Linear non-Gaussian Cyclic Models
por: Sharifian, Ehsan, et al.
Publicado: (2025)

Multi-level Monte-Carlo Gradient Methods for Stochastic Optimization with Biased Oracles
por: Hu, Yifan, et al.
Publicado: (2024)

MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters
por: Sharifnassab, Arsalan, et al.
Publicado: (2024)

Linear Convergence of Entropy-Regularized Natural Policy Gradient with Linear Function Approximation
por: Cayci, Semih, et al.
Publicado: (2021)

Projection-Free Functional Constrained Optimization for Risk Aversion and Sparsity Control
por: Cheng, Yi, et al.
Publicado: (2022)

Primal Methods for Variational Inequality Problems with Functional Constraints
por: Zhang, Liang, et al.
Publicado: (2024)

A Hessian-Aware Stochastic Differential Equation for Modelling SGD
por: Li, Xiang, et al.
Publicado: (2024)

On the Complexity of First-Order Methods in Stochastic Bilevel Optimization
por: Kwon, Jeongyeol, et al.
Publicado: (2024)

Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization
por: Zhang, Liang, et al.
Publicado: (2023)

Convergence and Sample Complexity of First-Order Methods for Agnostic Reinforcement Learning
por: Sherman, Uri, et al.
Publicado: (2025)

Multi-Domain Causal Discovery in Bijective Causal Models
por: Jalaldoust, Kasra, et al.
Publicado: (2025)

Stochastic Auto-conditioned Fast Gradient Methods with Optimal Rates
por: Ji, Yao, et al.
Publicado: (2026)

Causal Effect Identification in Heterogeneous Environments from Higher-Order Moments
por: Kivva, Yaroslav, et al.
Publicado: (2025)

Learning Unknown Intervention Targets in Structural Causal Models from Heterogeneous Data
por: Yang, Yuqin, et al.
Publicado: (2023)

On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
por: Kwon, Jeongyeol, et al.
Publicado: (2023)

Nearly Optimal Linear Convergence of Stochastic Primal-Dual Methods for Linear Programming
por: Lu, Haihao, et al.
Publicado: (2021)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
por: Liu, Zijian
Publicado: (2026)

A Methodology Establishing Linear Convergence of Adaptive Gradient Methods under PL Inequality
por: Chakrabarti, Kushal, et al.
Publicado: (2024)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
por: Lu, Eric
Publicado: (2025)

Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes
por: Huang, Yan, et al.
Publicado: (2024)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise
por: Pan, Rui, et al.
Publicado: (2023)

Convergence Rate of the Last Iterate of Stochastic Proximal Algorithms
por: Vaidyan, Kevin Kurian Thomas, et al.
Publicado: (2026)

Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
por: Grazzi, Riccardo, et al.
Publicado: (2024)

Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping
por: Liu, Zijian, et al.
Publicado: (2024)

Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate
por: Jiang, Ruichen, et al.
Publicado: (2024)

Adaptive Algorithms with Sharp Convergence Rates for Stochastic Hierarchical Optimization
por: Gong, Xiaochuan, et al.
Publicado: (2025)

Optimal Rates for Robust Stochastic Convex Optimization
por: Gao, Changyu, et al.
Publicado: (2024)

GPU-friendly and Linearly Convergent First-order Methods for Certifying Optimal $k$-sparse GLMs
por: Liu, Jiachang, et al.
Publicado: (2026)

From Gradient Clipping to Normalization for Heavy Tailed SGD
por: Hübler, Florian, et al.
Publicado: (2024)

TiAda: A Time-scale Adaptive Algorithm for Nonconvex Minimax Optimization
por: Li, Xiang, et al.
Publicado: (2022)

Bridging Constraints and Stochasticity: A Fully First-Order Method for Stochastic Bilevel Optimization with Linear Constraints
por: Phan, Cac, et al.
Publicado: (2025)

On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions
por: Hong, Yusu, et al.
Publicado: (2024)

Revisiting the Last-Iterate Convergence of Stochastic Gradient Methods
por: Liu, Zijian, et al.
Publicado: (2023)

Incremental Gauss--Newton Methods with Superlinear Convergence Rates
por: Zhou, Zhiling, et al.
Publicado: (2024)