Controlled Reach-avoid Set Computation for Discrete-time Polynomial Systems via Convex Optimization

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wu, Taoran, Xue, Yiling, Ren, Dejin, Easwaran, Arvind, Fränzle, Martin, Xue, Bai
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910993302421504
author Wu, Taoran
Xue, Yiling
Ren, Dejin
Easwaran, Arvind
Fränzle, Martin
Xue, Bai
author_facet Wu, Taoran
Xue, Yiling
Ren, Dejin
Easwaran, Arvind
Fränzle, Martin
Xue, Bai
contents This paper addresses the computation of controlled reach-avoid sets (CRASs) for discrete-time polynomial systems subject to control inputs. A CRAS is a set encompassing initial states from which there exist control inputs driving the system into a target set while avoiding unsafe sets. However, efficiently computing CRASs remains an open problem, especially for discrete-time systems. In this paper, we propose a novel framework for computing CRASs which takes advantage of a probabilistic perspective. This framework transforms the fundamentally nonlinear problem of computing CRASs into a computationally tractable convex optimization problem. By regarding control inputs as disturbances obeying certain probability distributions, a CRAS can be equivalently treated as a 0-reach-avoid set in the probabilistic sense, which consists of initial states from which the probability of eventually entering the target set while remaining within the safe set is greater than zero. Thus, we can employ the convex optimization method of computing 0-reach-avoid sets to estimate CRASs. Furthermore, inspired by the $ε$-greedy strategy widely used in reinforcement learning, we propose an approach that iteratively updates the aforementioned probability distributions imposed on control inputs to compute larger CRASs. We demonstrate the effectiveness of the proposed method on extensive examples.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06679
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Controlled Reach-avoid Set Computation for Discrete-time Polynomial Systems via Convex Optimization
Wu, Taoran
Xue, Yiling
Ren, Dejin
Easwaran, Arvind
Fränzle, Martin
Xue, Bai
Systems and Control
This paper addresses the computation of controlled reach-avoid sets (CRASs) for discrete-time polynomial systems subject to control inputs. A CRAS is a set encompassing initial states from which there exist control inputs driving the system into a target set while avoiding unsafe sets. However, efficiently computing CRASs remains an open problem, especially for discrete-time systems. In this paper, we propose a novel framework for computing CRASs which takes advantage of a probabilistic perspective. This framework transforms the fundamentally nonlinear problem of computing CRASs into a computationally tractable convex optimization problem. By regarding control inputs as disturbances obeying certain probability distributions, a CRAS can be equivalently treated as a 0-reach-avoid set in the probabilistic sense, which consists of initial states from which the probability of eventually entering the target set while remaining within the safe set is greater than zero. Thus, we can employ the convex optimization method of computing 0-reach-avoid sets to estimate CRASs. Furthermore, inspired by the $ε$-greedy strategy widely used in reinforcement learning, we propose an approach that iteratively updates the aforementioned probability distributions imposed on control inputs to compute larger CRASs. We demonstrate the effectiveness of the proposed method on extensive examples.
title Controlled Reach-avoid Set Computation for Discrete-time Polynomial Systems via Convex Optimization
topic Systems and Control
url https://arxiv.org/abs/2506.06679