Generalized Steepest Descent Methods on Riemannian Manifolds and Hilbert Spaces: Convergence Analysis and Stochastic Extensions
Fuente:
arXiv
Salvato in:
| Autori principali: | , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910847903727616 |
|---|---|
| author | A., Rashid Samad, Amal A |
| author_facet | A., Rashid Samad, Amal A |
| contents | Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian manifolds, leveraging the geometric structure of manifolds to extend optimization techniques beyond Euclidean spaces. The convergence analysis under generalized smoothness conditions of the steepest descent method is studied along with an illustrative example. We also explore adaptive steepest descent with momentum in infinite-dimensional Hilbert spaces, focusing on the interplay of step size adaptation, momentum decay, and weak convergence properties. Also, we arrived at a convergence accuracy of $O(\frac{1}{k^2})$. Finally, studied some stochastic steepest descent under non-Gaussian noise, where bounded higher-order moments replace Gaussian assumptions, leading to a guaranteed convergence, which is illustrated by an example. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19929 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generalized Steepest Descent Methods on Riemannian Manifolds and Hilbert Spaces: Convergence Analysis and Stochastic Extensions A., Rashid Samad, Amal A Optimization and Control Functional Analysis 46C05, 90C30, 90C90, 90C15, 65K10, 49Q99 Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian manifolds, leveraging the geometric structure of manifolds to extend optimization techniques beyond Euclidean spaces. The convergence analysis under generalized smoothness conditions of the steepest descent method is studied along with an illustrative example. We also explore adaptive steepest descent with momentum in infinite-dimensional Hilbert spaces, focusing on the interplay of step size adaptation, momentum decay, and weak convergence properties. Also, we arrived at a convergence accuracy of $O(\frac{1}{k^2})$. Finally, studied some stochastic steepest descent under non-Gaussian noise, where bounded higher-order moments replace Gaussian assumptions, leading to a guaranteed convergence, which is illustrated by an example. |
| title | Generalized Steepest Descent Methods on Riemannian Manifolds and Hilbert Spaces: Convergence Analysis and Stochastic Extensions |
| topic | Optimization and Control Functional Analysis 46C05, 90C30, 90C90, 90C15, 65K10, 49Q99 |
| url | https://arxiv.org/abs/2502.19929 |