A Riemannian gradient descent method for optimization on the indefinite Stiefel manifold
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917525639397376 |
|---|---|
| author | Van Tiep, Dinh Son, Nguyen Thanh |
| author_facet | Van Tiep, Dinh Son, Nguyen Thanh |
| contents | We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$, satisfying $J^2 = I_k$. Since the feasible set constitutes a differentiable manifold, called the indefinite Stiefel manifold, we approach this problem within the framework of Riemannian optimization. Namely, we first equip the manifold with a Riemannian metric and construct the associated geometric structure, then propose a retraction based on the Cayley transform, and finally suggest a Riemannian gradient descent method using the attained materials, whose global convergence is guaranteed. Our results not only cover the known cases, the orthogonal and generalized Stiefel manifolds, but also provide a Riemannian optimization solution for other constrained problems which has not been investigated. As applications, we consider, via trace minimization, several eigenvalue problems of symmetric positive definite matrix pencils, including the linear response eigenvalue problem, and a matrix least square problem, a general framework for the Procrustes problem and constrained matrix equations. The presented numerical results justify the theoretical findings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_22068 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Riemannian gradient descent method for optimization on the indefinite Stiefel manifold Van Tiep, Dinh Son, Nguyen Thanh Optimization and Control 65K05, 70G45, 90C48 We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$, satisfying $J^2 = I_k$. Since the feasible set constitutes a differentiable manifold, called the indefinite Stiefel manifold, we approach this problem within the framework of Riemannian optimization. Namely, we first equip the manifold with a Riemannian metric and construct the associated geometric structure, then propose a retraction based on the Cayley transform, and finally suggest a Riemannian gradient descent method using the attained materials, whose global convergence is guaranteed. Our results not only cover the known cases, the orthogonal and generalized Stiefel manifolds, but also provide a Riemannian optimization solution for other constrained problems which has not been investigated. As applications, we consider, via trace minimization, several eigenvalue problems of symmetric positive definite matrix pencils, including the linear response eigenvalue problem, and a matrix least square problem, a general framework for the Procrustes problem and constrained matrix equations. The presented numerical results justify the theoretical findings. |
| title | A Riemannian gradient descent method for optimization on the indefinite Stiefel manifold |
| topic | Optimization and Control 65K05, 70G45, 90C48 |
| url | https://arxiv.org/abs/2410.22068 |