Safe Primal-Dual Optimization with a Single Smooth Constraint

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Usmanova, Ilnura, Levy, Kfir Yehuda
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916737028456448
author Usmanova, Ilnura
Levy, Kfir Yehuda
author_facet Usmanova, Ilnura
Levy, Kfir Yehuda
contents This paper addresses the problem of safe optimization under a single smooth constraint, a scenario that arises in diverse real-world applications such as robotics and autonomous navigation. The objective of safe optimization is to solve a black-box minimization problem while strictly adhering to a safety constraint throughout the learning process. Existing methods often suffer from high sample complexity due to their noise sensitivity or poor scalability with number of dimensions, limiting their applicability. We propose a novel primal-dual optimization method that, by carefully adjusting dual step-sizes and constraining primal updates, ensures the safety of both primal and dual sequences throughout the optimization. Our algorithm achieves a convergence rate that significantly surpasses current state-of-the-art techniques. Furthermore, to the best of our knowledge, it is the first primal-dual approach to guarantee safe updates. Simulations corroborate our theoretical findings, demonstrating the practical benefits of our method. We also show how the method can be extended to multiple constraints.
format Preprint
id arxiv_https___arxiv_org_abs_2505_09349
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Safe Primal-Dual Optimization with a Single Smooth Constraint
Usmanova, Ilnura
Levy, Kfir Yehuda
Optimization and Control
This paper addresses the problem of safe optimization under a single smooth constraint, a scenario that arises in diverse real-world applications such as robotics and autonomous navigation. The objective of safe optimization is to solve a black-box minimization problem while strictly adhering to a safety constraint throughout the learning process. Existing methods often suffer from high sample complexity due to their noise sensitivity or poor scalability with number of dimensions, limiting their applicability. We propose a novel primal-dual optimization method that, by carefully adjusting dual step-sizes and constraining primal updates, ensures the safety of both primal and dual sequences throughout the optimization. Our algorithm achieves a convergence rate that significantly surpasses current state-of-the-art techniques. Furthermore, to the best of our knowledge, it is the first primal-dual approach to guarantee safe updates. Simulations corroborate our theoretical findings, demonstrating the practical benefits of our method. We also show how the method can be extended to multiple constraints.
title Safe Primal-Dual Optimization with a Single Smooth Constraint
topic Optimization and Control
url https://arxiv.org/abs/2505.09349