A New Branch-and-Bound Pruning Framework for $\ell_0$-Regularized Problems
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909218121973760 |
|---|---|
| author | Guyard, Theo Herzet, Cédric Elvira, Clément Arslan, Ayşe-Nur |
| author_facet | Guyard, Theo Herzet, Cédric Elvira, Clément Arslan, Ayşe-Nur |
| contents | We consider the resolution of learning problems involving $\ell_0$-regularization via Branch-and-Bound (BnB) algorithms. These methods explore regions of the feasible space of the problem and check whether they do not contain solutions through "pruning tests". In standard implementations, evaluating a pruning test requires to solve a convex optimization problem, which may result in computational bottlenecks. In this paper, we present an alternative to implement pruning tests for some generic family of $\ell_0$-regularized problems. Our proposed procedure allows the simultaneous assessment of several regions and can be embedded in standard BnB implementations with a negligible computational overhead. We show through numerical simulations that our pruning strategy can improve the solving time of BnB procedures by several orders of magnitude for typical problems encountered in machine-learning applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03504 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A New Branch-and-Bound Pruning Framework for $\ell_0$-Regularized Problems Guyard, Theo Herzet, Cédric Elvira, Clément Arslan, Ayşe-Nur Optimization and Control Machine Learning We consider the resolution of learning problems involving $\ell_0$-regularization via Branch-and-Bound (BnB) algorithms. These methods explore regions of the feasible space of the problem and check whether they do not contain solutions through "pruning tests". In standard implementations, evaluating a pruning test requires to solve a convex optimization problem, which may result in computational bottlenecks. In this paper, we present an alternative to implement pruning tests for some generic family of $\ell_0$-regularized problems. Our proposed procedure allows the simultaneous assessment of several regions and can be embedded in standard BnB implementations with a negligible computational overhead. We show through numerical simulations that our pruning strategy can improve the solving time of BnB procedures by several orders of magnitude for typical problems encountered in machine-learning applications. |
| title | A New Branch-and-Bound Pruning Framework for $\ell_0$-Regularized Problems |
| topic | Optimization and Control Machine Learning |
| url | https://arxiv.org/abs/2406.03504 |