Cover Image

Convergence Rate Analysis of SOAP with Arbitrary Orthogonal Projection Matrices

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Huan, Lin, Zhouchen
Format:	Preprint
Published:	2026
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Convergence Rate Analysis of LION
by: Dong, Yiming, et al.
Published: (2024)

Convergence Rate Analysis of the AdamW-Style Shampoo: Unifying One-Sided and Two-Sided Preconditioning
by: Li, Huan, et al.
Published: (2026)

On the $O(\frac{\sqrt{d}}{K^{1/4}})$ Convergence Rate of AdamW Measured by $\ell_1$ Norm
by: Li, Huan, et al.
Published: (2025)

On the $O(\frac{\sqrt{d}}{T^{1/4}})$ Convergence Rate of RMSProp and Its Momentum Extension Measured by $\ell_1$ Norm
by: Li, Huan, et al.
Published: (2024)

Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization
by: Li, Huan, et al.
Published: (2021)

Identification with Orthogonal Basis Functions: Convergence Speed, Asymptotic Bias, and Rate-Optimal Pole Selection
by: Li, Jiayun, et al.
Published: (2025)

First-Order Projected Algorithms With the Same Linear Convergence Rate Bounds as Their Unconstrained Counterparts
by: Li, Mengmou, et al.
Published: (2025)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
by: Xie, Xingyu, et al.
Published: (2022)

Robust Sublinear Convergence Rates for Iterative Bregman Projections
by: Peyré, Gabriel
Published: (2026)

Beyond likelihood ratio bias: Nested multi-time-scale stochastic approximation for likelihood-free parameter estimation
by: Li, Zehao, et al.
Published: (2024)

Convergence Rates for Stochastic Proximal and Projection Estimators
by: Morales, Diego, et al.
Published: (2026)

On the Convergence of Projected Policy Gradient for Any Constant Step Sizes
by: Liu, Jiacai, et al.
Published: (2023)

Convergence Rate Analysis for Monotone Accelerated Proximal Gradient Method
by: Wang, Zepeng, et al.
Published: (2025)

Global Convergence of Oja's Component Flow for General Square Matrices and Its Applications
by: Tsuzuki, Daiki, et al.
Published: (2025)

Asymptotic Convergence Analysis of High-Order Proximal-Point Methods Beyond Sublinear Rates
by: Ahookhosh, Masoud, et al.
Published: (2025)

Generalized Smooth Stochastic Variational Inequalities: Almost Sure Convergence and Convergence Rates
by: Vankov, Daniil, et al.
Published: (2024)

On the Convergence Rate of the One-Hop Transfer Algorithm
by: Jiang, Ruichao, et al.
Published: (2026)

Distributed Optimization Algorithm with Superlinear Convergence Rate
by: Xu, Yeming, et al.
Published: (2024)

Linear Convergence in Hilbert's Projective Metric for Computing Augustin Information and a Rényi Information Measure
by: Tsai, Chung-En, et al.
Published: (2024)

Generalized Orthogonal Procrustes Problem under Arbitrary Adversaries
by: Ling, Shuyang
Published: (2021)

Local Linear Convergence of Infeasible Optimization with Orthogonal Constraints
by: Sun, Youbang, et al.
Published: (2024)

Tight Analysis of Difference-of-Convex Algorithm (DCA) Improves Convergence Rates for Proximal Gradient Descent
by: Rotaru, Teodor, et al.
Published: (2025)

An Embarrassingly Simple Way to Optimize Orthogonal Matrices at Scale
by: Javaloy, Adrián, et al.
Published: (2026)

Reusing Historical Trajectories in Natural Policy Gradient via Importance Sampling: Convergence and Convergence Rate
by: Lin, Yifan, et al.
Published: (2024)

Convergence Analysis of the Self-Adaptive Projection Method for Variational Inequalities with Non-Lipschitz Continuous Operators
by: Wang, Meiying, et al.
Published: (2025)

Second-Order Bilevel Optimization with Accelerated Convergence Rates
by: Yang, Sheng, et al.
Published: (2026)

Multilevel Regularized Newton Methods with Fast Convergence Rates
by: Tsipinakis, Nick, et al.
Published: (2024)

A Proof of the Exact Convergence Rate of Gradient Descent
by: Kim, Jungbin
Published: (2024)

Anderson Acceleration Without Restart: A Novel Method with $n$-Step Super Quadratic Convergence Rate
by: Ye, Haishan, et al.
Published: (2024)

Theoretical Analysis on how Learning Rate Warmup Accelerates Convergence
by: Liu, Yuxing, et al.
Published: (2025)

Convergence Analysis of Stochastic Saddle Point Mirror Descent Algorithm -- A Projected Dynamical View Point
by: Paul, Anik Kumar, et al.
Published: (2024)

Factorization-free Orthogonal Projection onto the Positive Semidefinite Cone with Composite Polynomial Filtering
by: Kang, Shucheng, et al.
Published: (2025)

Convergence Rate Bounds for the Mirror Descent Method: IQCs, Popov Criterion and Bregman Divergence
by: Li, Mengmou, et al.
Published: (2023)

A Constructive Cayley Representation of Orthogonal Matrices and Applications to Optimization
by: Biborski, Iwo
Published: (2026)

Sharper Exponential Convergence Rates for Sinkhorn's Algorithm in Continuous Settings
by: Chizat, Lénaïc, et al.
Published: (2024)

Convergence Rate of Payoff-based Generalized Nash Equilibrium Learning
by: Tatarenko, Tatiana, et al.
Published: (2024)

Explicit Global Convergence Rates of BFGS without Line Search
by: Yu, Jianjiang, et al.
Published: (2025)

Convergence Rate of Learning a Strongly Variationally Stable Equilibrium
by: Tatarenko, Tatiana, et al.
Published: (2023)

Prox-DBRO-VR: A Unified Analysis on Byzantine-Resilient Decentralized Stochastic Composite Optimization with Variance Reduction and Non-Asymptotic Convergence Rates
by: Hu, Jinhui, et al.
Published: (2023)

Grassmannian Geometry and Global Convergence of Variable Projection for Neural Networks
by: Dus, Mathias
Published: (2026)