Acceleration via silver step-size on Riemannian manifolds with applications to Wasserstein space
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916958668062720 |
|---|---|
| author | Park, Jiyoung Roy, Abhishek Siegel, Jonathan W. Bhattacharya, Anirban |
| author_facet | Park, Jiyoung Roy, Abhishek Siegel, Jonathan W. Bhattacharya, Anirban |
| contents | There is extensive literature on accelerating first-order optimization methods in a Euclidean setting. Under which conditions such acceleration is feasible in Riemannian optimization problems is an active area of research. Motivated by the recent success of dynamic stepsize methods in the Euclidean setting, we undertake a study of such algorithms in the Riemannian setting. We provide the new class of algorithms determined by the choice of vector transport that allows the dynamic stepsize acceleration on Riemannian manifolds for the function classes associated with the corresponding vector transport. As a core application, we show our algorithm recovers the standard Wasserstein gradient descent on 2-Wasserstein space, and as a result provides the first provable accelerated gradient method in Wasserstein space. In addition, we validate the numerical strength of the algorithm for standard benchmark tasks on the space of symmetric positive definite matrices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_06160 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Acceleration via silver step-size on Riemannian manifolds with applications to Wasserstein space Park, Jiyoung Roy, Abhishek Siegel, Jonathan W. Bhattacharya, Anirban Optimization and Control Differential Geometry There is extensive literature on accelerating first-order optimization methods in a Euclidean setting. Under which conditions such acceleration is feasible in Riemannian optimization problems is an active area of research. Motivated by the recent success of dynamic stepsize methods in the Euclidean setting, we undertake a study of such algorithms in the Riemannian setting. We provide the new class of algorithms determined by the choice of vector transport that allows the dynamic stepsize acceleration on Riemannian manifolds for the function classes associated with the corresponding vector transport. As a core application, we show our algorithm recovers the standard Wasserstein gradient descent on 2-Wasserstein space, and as a result provides the first provable accelerated gradient method in Wasserstein space. In addition, we validate the numerical strength of the algorithm for standard benchmark tasks on the space of symmetric positive definite matrices. |
| title | Acceleration via silver step-size on Riemannian manifolds with applications to Wasserstein space |
| topic | Optimization and Control Differential Geometry |
| url | https://arxiv.org/abs/2506.06160 |