A flexible block-coordinate forward-backward algorithm for non-smooth and non-convex optimization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911240575516672 |
|---|---|
| author | Briceño-Arias, Luis Gonçalves, Paulo Lauga, Guillaume Pustelnik, Nelly Riccietti, Elisa |
| author_facet | Briceño-Arias, Luis Gonçalves, Paulo Lauga, Guillaume Pustelnik, Nelly Riccietti, Elisa |
| contents | Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the problem. The theoretical and practical performance of BCD relies heavily on the rules defining the choice of the blocks to be updated at each iteration. We propose a new deterministic BCD framework that allows for very flexible updates, while guaranteeing state-of-the-art convergence guarantees on non-smooth nonconvex optimization problems. While encompassing several update rules from the literature, this framework allows for priority on updates of particular blocks and correlations in the block selection between iterations, which is not permitted under the classical convergent stochastic framework. This flexibility is leveraged in the context of multilevel optimization algorithms and, in particular, in multilevel image restoration problems, where the efficiency of the approach is illustrated. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_26477 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A flexible block-coordinate forward-backward algorithm for non-smooth and non-convex optimization Briceño-Arias, Luis Gonçalves, Paulo Lauga, Guillaume Pustelnik, Nelly Riccietti, Elisa Optimization and Control Block coordinate descent (BCD) methods are prevalent in large scale optimization problems due to the low memory and computational costs per iteration, the predisposition to parallelization, and the ability to exploit the structure of the problem. The theoretical and practical performance of BCD relies heavily on the rules defining the choice of the blocks to be updated at each iteration. We propose a new deterministic BCD framework that allows for very flexible updates, while guaranteeing state-of-the-art convergence guarantees on non-smooth nonconvex optimization problems. While encompassing several update rules from the literature, this framework allows for priority on updates of particular blocks and correlations in the block selection between iterations, which is not permitted under the classical convergent stochastic framework. This flexibility is leveraged in the context of multilevel optimization algorithms and, in particular, in multilevel image restoration problems, where the efficiency of the approach is illustrated. |
| title | A flexible block-coordinate forward-backward algorithm for non-smooth and non-convex optimization |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2510.26477 |