Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909414619873280 |
|---|---|
| author | Qian, Yitian Tao, Ting Pan, Shaohua Qi, Houduo |
| author_facet | Qian, Yitian Tao, Ting Pan, Shaohua Qi, Houduo |
| contents | We propose a novel iterative framework for minimizing a proper lower semicontinuous Kurdyka-Łojasiewicz (KL) function $Φ$. It comprises a Zhang-Hager (ZH-type) nonmonotone decrease condition and a relative error condition. Hence, the sequence generated by the ZH-type nonmonotone descent methods will fall within this framework. Any sequence conforming to this framework is proved to converge to a critical point of $Φ$. If in addition $Φ$ has the KL property of exponent $θ\!\in(0,1)$ at the critical point, the convergence has a linear rate for $θ\in(0,1/2]$ and a sublinear rate of exponent $\frac{1-θ}{1-2θ}$ for $θ\in(1/2,1)$. To the best of our knowledge, this is the first work to establish the full convergence of the iterate sequence generated by a ZH-type nonmonotone descent method for nonconvex and nonsmooth optimization problems. The obtained results are also applied to achieve the full convergence of the iterate sequences produced by the proximal gradient method and Riemannian gradient method with the ZH-type nonmonotone line-search. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_05740 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems Qian, Yitian Tao, Ting Pan, Shaohua Qi, Houduo Optimization and Control 90C26, 65K05, 49M27 We propose a novel iterative framework for minimizing a proper lower semicontinuous Kurdyka-Łojasiewicz (KL) function $Φ$. It comprises a Zhang-Hager (ZH-type) nonmonotone decrease condition and a relative error condition. Hence, the sequence generated by the ZH-type nonmonotone descent methods will fall within this framework. Any sequence conforming to this framework is proved to converge to a critical point of $Φ$. If in addition $Φ$ has the KL property of exponent $θ\!\in(0,1)$ at the critical point, the convergence has a linear rate for $θ\in(0,1/2]$ and a sublinear rate of exponent $\frac{1-θ}{1-2θ}$ for $θ\in(1/2,1)$. To the best of our knowledge, this is the first work to establish the full convergence of the iterate sequence generated by a ZH-type nonmonotone descent method for nonconvex and nonsmooth optimization problems. The obtained results are also applied to achieve the full convergence of the iterate sequences produced by the proximal gradient method and Riemannian gradient method with the ZH-type nonmonotone line-search. |
| title | Convergence of ZH-type nonmonotone descent method for Kurdyka-Łojasiewicz optimization problems |
| topic | Optimization and Control 90C26, 65K05, 49M27 |
| url | https://arxiv.org/abs/2406.05740 |