Image de couverture de livre

Krylov Cubic Regularized Newton: A Subspace Second-Order Method with Dimension-Free Convergence Rate

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jiang, Ruichen, Raman, Parameswaran, Sabach, Shoham, Mokhtari, Aryan, Hong, Mingyi, Cevher, Volkan
Format:	Preprint
Publié:	2024
Sujets:	Optimization and Control Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MADA: Meta-Adaptive Optimizers through hyper-gradient Descent
par: Ozkara, Kaan, et autres
Publié: (2024)

Online Learning Guided Quasi-Newton Methods with Global Non-Asymptotic Convergence
par: Jiang, Ruichen, et autres
Publié: (2024)

Stochastic Newton Proximal Extragradient Method
par: Jiang, Ruichen, et autres
Publié: (2024)

Non-asymptotic Global Convergence Rates of BFGS with Exact Line Search
par: Jin, Qiujiang, et autres
Publié: (2024)

Improved Complexity for Smooth Nonconvex Optimization: A Two-Level Online Learning Approach with Quasi-Newton Methods
par: Jiang, Ruichen, et autres
Publié: (2024)

Non-asymptotic Global Convergence Analysis of BFGS with the Armijo-Wolfe Line Search
par: Jin, Qiujiang, et autres
Publié: (2024)

Online Learning-guided Learning Rate Adaptation via Gradient Alignment
par: Jiang, Ruichen, et autres
Publié: (2025)

Generalized Optimistic Methods for Convex-Concave Saddle Point Problems
par: Jiang, Ruichen, et autres
Publié: (2022)

Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization
par: Jiang, Ruichen, et autres
Publié: (2024)

An Inexact Conditional Gradient Method for Constrained Bilevel Optimization
par: Abolfazli, Nazanin, et autres
Publié: (2023)

Provable Complexity Improvement of AdaGrad over SGD: Upper and Lower Bounds in Stochastic Non-Convex Optimization
par: Jiang, Ruichen, et autres
Publié: (2024)

Improving Online-to-Nonconvex Conversion for Smooth Optimization via Double Optimism
par: Patitucci, Francisco, et autres
Publié: (2025)

Multilevel Regularized Newton Methods with Fast Convergence Rates
par: Tsipinakis, Nick, et autres
Publié: (2024)

An Accelerated Gradient Method for Convex Smooth Simple Bilevel Optimization
par: Cao, Jincheng, et autres
Publié: (2024)

Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models
par: Jin, Qiujiang, et autres
Publié: (2022)

Randomized Subspace Derivative-Free Optimization with Quadratic Models and Second-Order Convergence
par: Cartis, Coralia, et autres
Publié: (2024)

Adaptive Matrix Online Learning through Smoothing with Guarantees for Nonsmooth Nonconvex Optimization
par: Jiang, Ruichen, et autres
Publié: (2026)

An Adaptive Cubic Regularization quasi-Newton Method on Riemannian Manifolds
par: Louzeiro, Mauricio S., et autres
Publié: (2024)

Affine-Invariant Global Non-Asymptotic Convergence Analysis of BFGS under Self-Concordance
par: Jin, Qiujiang, et autres
Publié: (2025)

On the Complexity of Finding Stationary Points in Nonconvex Simple Bilevel Optimization
par: Cao, Jincheng, et autres
Publié: (2025)

EMC$^2$: Efficient MCMC Negative Sampling for Contrastive Learning with Global Convergence
par: Yau, Chung-Yiu, et autres
Publié: (2024)

Dynamic FISTA for Convex Composite Bi-Level Optimization
par: Merchav, Roey, et autres
Publié: (2024)

Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods
par: Chayti, El Mahdi, et autres
Publié: (2023)

A Convergent Generalized Krylov Subspace Method for Compressed Sensing MRI Reconstruction with Gradient-Driven Denoisers
par: Hong, Tao, et autres
Publié: (2025)

Subspace Newton's Method for $\ell_0$-Regularized Optimization Problems with Box Constraint
par: Ye, Yuge, et autres
Publié: (2025)

Random Subspace Cubic-Regularization Methods, with Applications to Low-Rank Functions
par: Cartis, Coralia, et autres
Publié: (2025)

Homogeneous Second-Order Descent Framework: A Fast Alternative to Newton-Type Methods
par: He, Chang, et autres
Publié: (2023)

Second-Order Bilevel Optimization with Accelerated Convergence Rates
par: Yang, Sheng, et autres
Publié: (2026)

Incremental Gauss--Newton Methods with Superlinear Convergence Rates
par: Zhou, Zhiling, et autres
Publié: (2024)

A Regularized Hessian-Free Inexact Newton-Type Method with Global $\mathcal{O}(k^{-2})$ Convergence
par: Maia, Leandro Farias, et autres
Publié: (2026)

Cubic Regularization Technique of the Newton Method for Vector Optimization
par: Ghosh, Debdas
Publié: (2025)

A Note on the Convergence of Muon
par: Li, Jiaxiang, et autres
Publié: (2025)

Zeroth-order Stochastic Cubic Newton Method Revisited
par: Liu, Yu, et autres
Publié: (2024)

Decentralized Inexact Cubic Newton Method with Consensus Procedure
par: Agafonov, Artem, et autres
Publié: (2026)

Subspace Quasi-Newton Method with Gradient Approximation
par: Miyaishi, Taisei, et autres
Publié: (2024)

Universal Gradient Methods for Stochastic Convex Optimization
par: Rodomanov, Anton, et autres
Publié: (2024)

Incremental Quasi-Newton Methods with Faster Superlinear Convergence Rates
par: Liu, Zhuanghua, et autres
Publié: (2024)

Krylov Subspace Acceleration for First-Order Splitting Methods in Convex Quadratic Programming
par: Pereira, Gabriel Berk, et autres
Publié: (2025)

LeAP-SSN: A Semismooth Newton Method with Global Convergence Rates
par: Alphonse, Amal, et autres
Publié: (2025)

Adaptive Optimization via Momentum on Variance-Normalized Gradients
par: Patitucci, Francisco, et autres
Publié: (2026)