An inexact golden ratio primal-dual algorithm with linesearch step for a saddle point problem
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915503737405440 |
|---|---|
| author | Fang, Changjie Liu, Jinxiu Qiu, Jingtao Chen, Shenglan |
| author_facet | Fang, Changjie Liu, Jinxiu Qiu, Jingtao Chen, Shenglan |
| contents | In this paper, we propose an inexact golden ratio primal-dual algorithm with linesearch step(IP-GRPDAL) for solving the saddle point problems, where two subproblems can be approximately solved by applying the notations of inexact extended proximal operators with matrix norm. Our proposed IP-GRPDAL method allows for larger stepsizes by replacing the extrapolation step with a convex combination step. Each iteration of the linesearch requires to update only the dual variable, and hence it is quite cheap. In addition, we prove convergence of the proposed algorithm and show an O(1/N) ergodic convergence rate for our algorithm, where N represents the number of iterations. When one of the component functions is strongly convex, the accelerated O(1/N2) convergence rate results are established by choosing adaptively some algorithmic parameters. Furthermore, when both component functions are strongy convex, the linear convergence rate results are achieved. Numerical simulation results on the sparse recovery and image deblurring problems illustrate the feasibility and efficiency of our inexact algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_08519 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An inexact golden ratio primal-dual algorithm with linesearch step for a saddle point problem Fang, Changjie Liu, Jinxiu Qiu, Jingtao Chen, Shenglan Optimization and Control In this paper, we propose an inexact golden ratio primal-dual algorithm with linesearch step(IP-GRPDAL) for solving the saddle point problems, where two subproblems can be approximately solved by applying the notations of inexact extended proximal operators with matrix norm. Our proposed IP-GRPDAL method allows for larger stepsizes by replacing the extrapolation step with a convex combination step. Each iteration of the linesearch requires to update only the dual variable, and hence it is quite cheap. In addition, we prove convergence of the proposed algorithm and show an O(1/N) ergodic convergence rate for our algorithm, where N represents the number of iterations. When one of the component functions is strongly convex, the accelerated O(1/N2) convergence rate results are established by choosing adaptively some algorithmic parameters. Furthermore, when both component functions are strongy convex, the linear convergence rate results are achieved. Numerical simulation results on the sparse recovery and image deblurring problems illustrate the feasibility and efficiency of our inexact algorithms. |
| title | An inexact golden ratio primal-dual algorithm with linesearch step for a saddle point problem |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2408.08519 |