Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Marzari, Luca, Trotti, Francesco, Marchesini, Enrico, Farinelli, Alessandro
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918005422686208
author Marzari, Luca
Trotti, Francesco
Marchesini, Enrico
Farinelli, Alessandro
author_facet Marzari, Luca
Trotti, Francesco
Marchesini, Enrico
Farinelli, Alessandro
contents Achieving safe autonomous navigation systems is critical for deploying robots in dynamic and uncertain real-world environments. In this paper, we propose a hierarchical control framework leveraging neural network verification techniques to design control barrier functions (CBFs) and policy correction mechanisms that ensure safe reinforcement learning navigation policies. Our approach relies on probabilistic enumeration to identify unsafe regions of operation, which are then used to construct a safe CBF-based control layer applicable to arbitrary policies. We validate our framework both in simulation and on a real robot, using a standard mobile robot benchmark and a highly dynamic aquatic environmental monitoring task. These experiments demonstrate the ability of the proposed solution to correct unsafe actions while preserving efficient navigation behavior. Our results show the promise of developing hierarchical verification-based systems to enable safe and robust navigation behaviors in complex scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2504_21643
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation
Marzari, Luca
Trotti, Francesco
Marchesini, Enrico
Farinelli, Alessandro
Artificial Intelligence
Robotics
Achieving safe autonomous navigation systems is critical for deploying robots in dynamic and uncertain real-world environments. In this paper, we propose a hierarchical control framework leveraging neural network verification techniques to design control barrier functions (CBFs) and policy correction mechanisms that ensure safe reinforcement learning navigation policies. Our approach relies on probabilistic enumeration to identify unsafe regions of operation, which are then used to construct a safe CBF-based control layer applicable to arbitrary policies. We validate our framework both in simulation and on a real robot, using a standard mobile robot benchmark and a highly dynamic aquatic environmental monitoring task. These experiments demonstrate the ability of the proposed solution to correct unsafe actions while preserving efficient navigation behavior. Our results show the promise of developing hierarchical verification-based systems to enable safe and robust navigation behaviors in complex scenarios.
title Designing Control Barrier Function via Probabilistic Enumeration for Safe Reinforcement Learning Navigation
topic Artificial Intelligence
Robotics
url https://arxiv.org/abs/2504.21643