Structured Nonsmooth Optimization Using Functional Encoding and Branching Information
Fuente:
arXiv
Salvato in:
| Autore principale: | |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916723040452608 |
|---|---|
| author | Luo, Fengqiao |
| author_facet | Luo, Fengqiao |
| contents | We develop a novel gradient-based algorithm for optimizing nonsmooth nonconvex functions where nonsmoothness arises from explicit nonsmooth operators in the objective's analytical form. Our key innovation involves encoding active smooth branches of these operators, enabling both branch function extraction at arbitrary points and transition detection through branch tracking. This approach yields a Branch-Information-Driven Gradient Descent (BIGD) method for encodable piecewise-differentiable functions, with an enhanced version achieving local linear convergence under appropriate conditions. The computationally efficient encoding mechanism is straightforward to implement. The power of using branch information has been proved via substantial numerical experiments compared to some existing nonsmooth optimization methods on standard test problems. Most importantly, for piecewise-smooth problems given analytical expressions, implementation of functional encoding can be integrated into a wide range of existing nonsmooth optimization methods to improve the bundle points management, reduce the complexity of the quadratic programming sub-problems, and improve the efficiency of line search. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_16273 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Structured Nonsmooth Optimization Using Functional Encoding and Branching Information Luo, Fengqiao Optimization and Control 90C26, 80M50 We develop a novel gradient-based algorithm for optimizing nonsmooth nonconvex functions where nonsmoothness arises from explicit nonsmooth operators in the objective's analytical form. Our key innovation involves encoding active smooth branches of these operators, enabling both branch function extraction at arbitrary points and transition detection through branch tracking. This approach yields a Branch-Information-Driven Gradient Descent (BIGD) method for encodable piecewise-differentiable functions, with an enhanced version achieving local linear convergence under appropriate conditions. The computationally efficient encoding mechanism is straightforward to implement. The power of using branch information has been proved via substantial numerical experiments compared to some existing nonsmooth optimization methods on standard test problems. Most importantly, for piecewise-smooth problems given analytical expressions, implementation of functional encoding can be integrated into a wide range of existing nonsmooth optimization methods to improve the bundle points management, reduce the complexity of the quadratic programming sub-problems, and improve the efficiency of line search. |
| title | Structured Nonsmooth Optimization Using Functional Encoding and Branching Information |
| topic | Optimization and Control 90C26, 80M50 |
| url | https://arxiv.org/abs/2404.16273 |