Online convex optimization for constrained control of nonlinear systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nonhoff, Marko, Köhler, Johannes, Müller, Matthias A.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909684806451200
author Nonhoff, Marko
Köhler, Johannes
Müller, Matthias A.
author_facet Nonhoff, Marko
Köhler, Johannes
Müller, Matthias A.
contents This paper proposes a modular approach that combines the online convex optimization framework and reference governors to solve a constrained control problem featuring time-varying and a priori unknown cost functions. Compared to existing results, the proposed framework is uniquely applicable to nonlinear dynamical systems subject to state and input constraints. Furthermore, our method is general in the sense that we do not limit our analysis to a specific choice of online convex optimization algorithm or reference governor. We show that the dynamic regret of the proposed framework is bounded linearly in both the dynamic regret and the path length of the chosen online convex optimization algorithm, even though the online convex optimization algorithm does not account for the underlying dynamics. We prove that a linear bound with respect to the online convex optimization algorithm's dynamic regret is optimal, i.e., cannot be improved upon. Furthermore, for a standard class of online convex optimization algorithms, our proposed framework attains a bound on its dynamic regret that is linear only in the variation of the cost functions, which is known to be an optimal bound. Finally, we demonstrate implementation and flexibility of the proposed framework by comparing different combinations of online convex optimization algorithms and reference governors to control a nonlinear chemical reactor in a numerical experiment.
format Preprint
id arxiv_https___arxiv_org_abs_2412_00922
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Online convex optimization for constrained control of nonlinear systems
Nonhoff, Marko
Köhler, Johannes
Müller, Matthias A.
Systems and Control
Optimization and Control
This paper proposes a modular approach that combines the online convex optimization framework and reference governors to solve a constrained control problem featuring time-varying and a priori unknown cost functions. Compared to existing results, the proposed framework is uniquely applicable to nonlinear dynamical systems subject to state and input constraints. Furthermore, our method is general in the sense that we do not limit our analysis to a specific choice of online convex optimization algorithm or reference governor. We show that the dynamic regret of the proposed framework is bounded linearly in both the dynamic regret and the path length of the chosen online convex optimization algorithm, even though the online convex optimization algorithm does not account for the underlying dynamics. We prove that a linear bound with respect to the online convex optimization algorithm's dynamic regret is optimal, i.e., cannot be improved upon. Furthermore, for a standard class of online convex optimization algorithms, our proposed framework attains a bound on its dynamic regret that is linear only in the variation of the cost functions, which is known to be an optimal bound. Finally, we demonstrate implementation and flexibility of the proposed framework by comparing different combinations of online convex optimization algorithms and reference governors to control a nonlinear chemical reactor in a numerical experiment.
title Online convex optimization for constrained control of nonlinear systems
topic Systems and Control
Optimization and Control
url https://arxiv.org/abs/2412.00922