Krylov Subspace Acceleration for First-Order Splitting Methods in Convex Quadratic Programming
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917390721220608 |
|---|---|
| author | Pereira, Gabriel Berk Goulart, Paul J. |
| author_facet | Pereira, Gabriel Berk Goulart, Paul J. |
| contents | We propose an acceleration scheme for first-order methods (FOMs) for convex quadratic programs (QPs) that is analogous to Anderson acceleration and the Generalized Minimal Residual algorithm for linear systems. We motivate our proposed method from the observation that FOMs applied to QPs typically consist of piecewise-affine operators. We describe our Krylov subspace acceleration scheme, contrasting it with existing Anderson acceleration schemes and showing that it largely avoids the latter's well-known ill-conditioning issues in regions of slow convergence. We demonstrate the performance of our scheme relative to Anderson acceleration using standard collections of problems from model predictive control and statistical learning applications. We show that our method is faster than Anderson acceleration across the board in terms of iteration count, and in many cases in computation time, particularly for optimal control and for problems solved to high accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_06323 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Krylov Subspace Acceleration for First-Order Splitting Methods in Convex Quadratic Programming Pereira, Gabriel Berk Goulart, Paul J. Optimization and Control 65K05 (Primary) 90-08 (Secondary) We propose an acceleration scheme for first-order methods (FOMs) for convex quadratic programs (QPs) that is analogous to Anderson acceleration and the Generalized Minimal Residual algorithm for linear systems. We motivate our proposed method from the observation that FOMs applied to QPs typically consist of piecewise-affine operators. We describe our Krylov subspace acceleration scheme, contrasting it with existing Anderson acceleration schemes and showing that it largely avoids the latter's well-known ill-conditioning issues in regions of slow convergence. We demonstrate the performance of our scheme relative to Anderson acceleration using standard collections of problems from model predictive control and statistical learning applications. We show that our method is faster than Anderson acceleration across the board in terms of iteration count, and in many cases in computation time, particularly for optimal control and for problems solved to high accuracy. |
| title | Krylov Subspace Acceleration for First-Order Splitting Methods in Convex Quadratic Programming |
| topic | Optimization and Control 65K05 (Primary) 90-08 (Secondary) |
| url | https://arxiv.org/abs/2511.06323 |