Imagen de Portada

A Stochastic Quasi-Newton Method for Non-convex Optimization with Non-uniform Smoothness

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sun, Zhenyu, Wei, Ermin
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Decentralized Non-convex Stochastic Optimization with Heterogeneous Variance
por: Chen, Hongxu, et al.
Publicado: (2026)

Optimal Stochastic Non-smooth Non-convex Optimization through Online-to-Non-convex Conversion
por: Cutkosky, Ashok, et al.
Publicado: (2023)

Provable Adaptivity of Adam under Non-uniform Smoothness
por: Wang, Bohan, et al.
Publicado: (2022)

Complexity Lower Bounds of Adaptive Gradient Algorithms for Non-convex Stochastic Optimization under Relaxed Smoothness
por: Crawshaw, Michael, et al.
Publicado: (2025)

Non-convex Stochastic Composite Optimization with Polyak Momentum
por: Gao, Yuan, et al.
Publicado: (2024)

Stochastic Non-Smooth Convex Optimization with Unbounded Gradients
por: Kovalev, Dmitry
Publicado: (2026)

Online Learning Guided Quasi-Newton Methods with Global Non-Asymptotic Convergence
por: Jiang, Ruichen, et al.
Publicado: (2024)

On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond
por: Wang, Bohan, et al.
Publicado: (2024)

Improved Complexity for Smooth Nonconvex Optimization: A Two-Level Online Learning Approach with Quasi-Newton Methods
por: Jiang, Ruichen, et al.
Publicado: (2024)

An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
por: Orvieto, Antonio, et al.
Publicado: (2024)

Non-Asymptotic Optimization and Generalization Bounds for Stochastic Gauss-Newton in Overparameterized Models
por: Cayci, Semih
Publicado: (2025)

Online Non-convex Optimization with Long-term Non-convex Constraints
por: Pan, Shijie, et al.
Publicado: (2023)

A Proximal Modified Quasi-Newton Method for Nonsmooth Regularized Optimization
por: Diouane, Youssef, et al.
Publicado: (2024)

Random Scaling and Momentum for Non-smooth Non-convex Optimization
por: Zhang, Qinzi, et al.
Publicado: (2024)

High Probability Complexity Bounds for Non-Smooth Stochastic Optimization with Heavy-Tailed Noise
por: Gorbunov, Eduard, et al.
Publicado: (2021)

Retraction-Free Decentralized Non-convex Optimization with Orthogonal Constraints
por: Sun, Youbang, et al.
Publicado: (2024)

Sharpened Lazy Incremental Quasi-Newton Method
por: Lahoti, Aakash, et al.
Publicado: (2023)

A Smoothing Newton Method for Rank-one Matrix Recovery
por: Maunu, Tyler, et al.
Publicado: (2025)

Stochastic Newton Proximal Extragradient Method
por: Jiang, Ruichen, et al.
Publicado: (2024)

Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
por: Chen, Lesi, et al.
Publicado: (2025)

Methods with Local Steps and Random Reshuffling for Generally Smooth Non-Convex Federated Optimization
por: Demidovich, Yury, et al.
Publicado: (2024)

Incremental Quasi-Newton Methods with Faster Superlinear Convergence Rates
por: Liu, Zhuanghua, et al.
Publicado: (2024)

Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees
por: Agafonov, Artem, et al.
Publicado: (2025)

Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization
por: Yu, Yaxin, et al.
Publicado: (2026)

Convergence of Steepest Descent and Adam under Non-Uniform Smoothness
por: Vaswani, Sharan, et al.
Publicado: (2026)

A Retrospective Approximation Approach for Smooth Stochastic Optimization
por: Newton, David, et al.
Publicado: (2021)

Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
por: Veprikov, Andrey, et al.
Publicado: (2025)

Adaptive Gradient Normalization and Independent Sampling for (Stochastic) Generalized-Smooth Optimization
por: Yang, Yufeng, et al.
Publicado: (2024)

New Lower Bounds for Stochastic Non-Convex Optimization through Divergence Decomposition
por: Saad, El Mehdi, et al.
Publicado: (2025)

Riemannian Optimization for Non-convex Euclidean Distance Geometry with Global Recovery Guarantees
por: Smith, Chandler, et al.
Publicado: (2024)

Online Non-Stationary Stochastic Quasar-Convex Optimization
por: Pun, Yuen-Man, et al.
Publicado: (2024)

Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems
por: Buckingham, Jack M., et al.
Publicado: (2024)

On Constraints in First-Order Optimization: A View from Non-Smooth Dynamical Systems
por: Muehlebach, Michael, et al.
Publicado: (2021)

Explicit and Non-asymptotic Query Complexities of Rank-Based Zeroth-order Algorithm on Stochastic Smooth Functions
por: Ye, Haishan
Publicado: (2025)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
por: Chayti, El Mahdi, et al.
Publicado: (2023)

Non-geodesically-convex optimization in the Wasserstein space
por: Luu, Hoang Phuc Hau, et al.
Publicado: (2024)

Decentralized Stochastic Nonconvex Optimization under the Relaxed Smoothness
por: Luo, Luo, et al.
Publicado: (2025)

Convex and Non-convex Federated Learning with Stale Stochastic Gradients: Diminishing Step Size is All You Need
por: Zheng, Xinran, et al.
Publicado: (2026)

A Unified Theory of Stochastic Proximal Point Methods without Smoothness
por: Richtárik, Peter, et al.
Publicado: (2024)

A Regularized Online Newton Method for Stochastic Convex Bandits with Linear Vanishing Noise
por: Zhan, Jingxin, et al.
Publicado: (2025)