Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.11145 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912828030451712 |
|---|---|
| author | Chehab, Jean-Paul Kemlin, Gaspard Raydan, Marcos Saad, Yousef |
| author_facet | Chehab, Jean-Paul Kemlin, Gaspard Raydan, Marcos Saad, Yousef |
| contents | Several strategies are described and analyzed to speed-up gradient-type methods when applied to the minimization of strictly convex quadratics and strictly convex functions. The proposed techniques focus on relaxing the traditional optimal step length associated with gradient methods, including the steepest descent (SD) and the minimal residual (MR) methods. Such a relaxation avoids the well-known negative zigzag effect and allows the iterates to move in the entire space which in turn implies that every so often the search direction approaches some eigenvector of the underlying Hessian matrix. The proposed speedups then rely on taking advantage of the properties of the Lanczos method once a search direction that approaches an eigenvector has been identified in order to accelerate the convergence towards the global minimizer. After analyzing the proposed strategies, we illustrate them on the global minimization of strictly convex functions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_11145 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Eigenvector-based acceleration strategies for gradient-type methods Chehab, Jean-Paul Kemlin, Gaspard Raydan, Marcos Saad, Yousef Numerical Analysis Several strategies are described and analyzed to speed-up gradient-type methods when applied to the minimization of strictly convex quadratics and strictly convex functions. The proposed techniques focus on relaxing the traditional optimal step length associated with gradient methods, including the steepest descent (SD) and the minimal residual (MR) methods. Such a relaxation avoids the well-known negative zigzag effect and allows the iterates to move in the entire space which in turn implies that every so often the search direction approaches some eigenvector of the underlying Hessian matrix. The proposed speedups then rely on taking advantage of the properties of the Lanczos method once a search direction that approaches an eigenvector has been identified in order to accelerate the convergence towards the global minimizer. After analyzing the proposed strategies, we illustrate them on the global minimization of strictly convex functions. |
| title | Eigenvector-based acceleration strategies for gradient-type methods |
| topic | Numerical Analysis |
| url | https://arxiv.org/abs/2601.11145 |