Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911474770771968 |
|---|---|
| author | Khanh, Pham Duy Mordukhovich, Boris S. Phat, Vo Thanh |
| author_facet | Khanh, Pham Duy Mordukhovich, Boris S. Phat, Vo Thanh |
| contents | This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex structured sums. We also develop a novel line search method, which is an extension of the proximal gradient algorithm while allowing us to globalize the proposed coderivative-based Newton methods by incorporating the machinery of forward-backward envelopes. Applications and numerical experiments, which are provided for nonconvex least squares regression models, Student's t-regression with an $\ell^0$-penalty, and image restoration problems, demonstrate the efficiency of the proposed algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_04262 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization Khanh, Pham Duy Mordukhovich, Boris S. Phat, Vo Thanh Optimization and Control This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and generalized differentiation. The objective functions belong to a broad class of prox-regular functions with specification to constrained optimization of nonconvex structured sums. We also develop a novel line search method, which is an extension of the proximal gradient algorithm while allowing us to globalize the proposed coderivative-based Newton methods by incorporating the machinery of forward-backward envelopes. Applications and numerical experiments, which are provided for nonconvex least squares regression models, Student's t-regression with an $\ell^0$-penalty, and image restoration problems, demonstrate the efficiency of the proposed algorithms. |
| title | Coderivative-Based Newton Methods in Structured Nonconvex and Nonsmooth Optimization |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2403.04262 |