Optimization by Directional Attacks: Solving Problems with Neural Network Surrogates
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909820537274368 |
|---|---|
| author | Bouchet, Pierre-Yves Vidal, Thibaut |
| author_facet | Bouchet, Pierre-Yves Vidal, Thibaut |
| contents | This paper tackles optimization problems whose objective and constraints involve a trained Neural Network (NN), where the goal is to maximize $f(Φ(x))$ subject to $c(Φ(x)) \leq 0$, with $f$ smooth, $c$ general and non-stringent, and $Φ$ an already trained and possibly nonwhite-box NN. We address two challenges regarding this problem: identifying ascent directions for local search, and ensuring reliable convergence towards relevant local solutions. To this end, we re-purpose the notion of directional NN attacks as efficient optimization subroutines, since directional NN attacks use the neural structure of $Φ$ to compute perturbations of $x$ that steer $Φ(x)$ in prescribed directions. Precisely, we develop an attack operator that computes attacks of $Φ$ at any $x$ along the direction $\nabla f(Φ(x))$. Then, we propose a hybrid algorithm combining the attack operator with derivative-free optimization (DFO) techniques, designed for numerical reliability by remaining oblivious to the structure of the problem. We consider the cDSM algorithm, which offers asymptotic guarantees to converge to a local solution under mild assumptions on the problem. The resulting method alternates between attack-based steps for heuristic yet fast local intensification and cDSM steps for certified convergence and numerical reliability. Experiments on three problems show that this hybrid approach consistently outperforms standard DFO baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_01461 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Optimization by Directional Attacks: Solving Problems with Neural Network Surrogates Bouchet, Pierre-Yves Vidal, Thibaut Optimization and Control This paper tackles optimization problems whose objective and constraints involve a trained Neural Network (NN), where the goal is to maximize $f(Φ(x))$ subject to $c(Φ(x)) \leq 0$, with $f$ smooth, $c$ general and non-stringent, and $Φ$ an already trained and possibly nonwhite-box NN. We address two challenges regarding this problem: identifying ascent directions for local search, and ensuring reliable convergence towards relevant local solutions. To this end, we re-purpose the notion of directional NN attacks as efficient optimization subroutines, since directional NN attacks use the neural structure of $Φ$ to compute perturbations of $x$ that steer $Φ(x)$ in prescribed directions. Precisely, we develop an attack operator that computes attacks of $Φ$ at any $x$ along the direction $\nabla f(Φ(x))$. Then, we propose a hybrid algorithm combining the attack operator with derivative-free optimization (DFO) techniques, designed for numerical reliability by remaining oblivious to the structure of the problem. We consider the cDSM algorithm, which offers asymptotic guarantees to converge to a local solution under mild assumptions on the problem. The resulting method alternates between attack-based steps for heuristic yet fast local intensification and cDSM steps for certified convergence and numerical reliability. Experiments on three problems show that this hybrid approach consistently outperforms standard DFO baselines. |
| title | Optimization by Directional Attacks: Solving Problems with Neural Network Surrogates |
| topic | Optimization and Control |
| url | https://arxiv.org/abs/2510.01461 |