Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tabbara, Ihab, Yang, Yuxuan, Sibai, Hussein
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912720139321344
author Tabbara, Ihab
Yang, Yuxuan
Sibai, Hussein
author_facet Tabbara, Ihab
Yang, Yuxuan
Sibai, Hussein
contents Safety assurance is a fundamental requirement for deploying learning-enabled autonomous systems. Hamilton-Jacobi (HJ) reachability analysis is a fundamental method for formally verifying safety and generating safe controllers. However, computing the HJ value function that characterizes the backward reachable set (BRS) of a set of user-defined failure states is computationally expensive, especially for high-dimensional systems, motivating the use of reinforcement learning approaches to approximate the value function. Unfortunately, a learned value function and its corresponding safe policy are not guaranteed to be correct. The learned value function evaluated at a given state may not be equal to the actual safety return achieved by following the learned safe policy. To address this challenge, we introduce a conformal prediction-based (CP) framework that bounds such uncertainty. We leverage CP to provide probabilistic safety guarantees when using learned HJ value functions and policies to prevent control systems from reaching failure states. Specifically, we use CP to calibrate the switching between the unsafe nominal controller and the learned HJ-based safe policy and to derive safety guarantees under this switched policy. We also investigate using an ensemble of independently trained HJ value functions as a safety filter and compare this ensemble approach to using individual value functions alone.
format Preprint
id arxiv_https___arxiv_org_abs_2511_07899
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Prediction
Tabbara, Ihab
Yang, Yuxuan
Sibai, Hussein
Machine Learning
Artificial Intelligence
Robotics
Systems and Control
Safety assurance is a fundamental requirement for deploying learning-enabled autonomous systems. Hamilton-Jacobi (HJ) reachability analysis is a fundamental method for formally verifying safety and generating safe controllers. However, computing the HJ value function that characterizes the backward reachable set (BRS) of a set of user-defined failure states is computationally expensive, especially for high-dimensional systems, motivating the use of reinforcement learning approaches to approximate the value function. Unfortunately, a learned value function and its corresponding safe policy are not guaranteed to be correct. The learned value function evaluated at a given state may not be equal to the actual safety return achieved by following the learned safe policy. To address this challenge, we introduce a conformal prediction-based (CP) framework that bounds such uncertainty. We leverage CP to provide probabilistic safety guarantees when using learned HJ value functions and policies to prevent control systems from reaching failure states. Specifically, we use CP to calibrate the switching between the unsafe nominal controller and the learned HJ-based safe policy and to derive safety guarantees under this switched policy. We also investigate using an ensemble of independently trained HJ value functions as a safety filter and compare this ensemble approach to using individual value functions alone.
title Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Prediction
topic Machine Learning
Artificial Intelligence
Robotics
Systems and Control
url https://arxiv.org/abs/2511.07899