Shield Synthesis for LTL Modulo Theories

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Rodriguez, Andoni, Amir, Guy, Corsi, Davide, Sanchez, Cesar, Katz, Guy
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917921795604480
author Rodriguez, Andoni
Amir, Guy
Corsi, Davide
Sanchez, Cesar
Katz, Guy
author_facet Rodriguez, Andoni
Amir, Guy
Corsi, Davide
Sanchez, Cesar
Katz, Guy
contents In recent years, Machine Learning (ML) models have achieved remarkable success in various domains. However, these models also tend to demonstrate unsafe behaviors, precluding their deployment in safety-critical systems. To cope with this issue, ample research focuses on developing methods that guarantee the safe behaviour of a given ML model. A prominent example is shielding which incorporates an external component (a ``shield'') that blocks unwanted behavior. Despite significant progress, shielding suffers from a main setback: it is currently geared towards properties encoded solely in propositional logics (e.g., LTL) and is unsuitable for richer logics. This, in turn, limits the widespread applicability of shielding in many real-world systems. In this work, we address this gap, and extend shielding to LTL modulo theories, by building upon recent advances in reactive synthesis modulo theories. This allowed us to develop a novel approach for generating shields conforming to complex safety specifications in these more expressive, logics. We evaluated our shields and demonstrate their ability to handle rich data with temporal dynamics. To the best of our knowledge, this is the first approach for synthesizing shields for such expressivity.
format Preprint
id arxiv_https___arxiv_org_abs_2406_04184
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Shield Synthesis for LTL Modulo Theories
Rodriguez, Andoni
Amir, Guy
Corsi, Davide
Sanchez, Cesar
Katz, Guy
Logic in Computer Science
Artificial Intelligence
Machine Learning
Robotics
In recent years, Machine Learning (ML) models have achieved remarkable success in various domains. However, these models also tend to demonstrate unsafe behaviors, precluding their deployment in safety-critical systems. To cope with this issue, ample research focuses on developing methods that guarantee the safe behaviour of a given ML model. A prominent example is shielding which incorporates an external component (a ``shield'') that blocks unwanted behavior. Despite significant progress, shielding suffers from a main setback: it is currently geared towards properties encoded solely in propositional logics (e.g., LTL) and is unsuitable for richer logics. This, in turn, limits the widespread applicability of shielding in many real-world systems. In this work, we address this gap, and extend shielding to LTL modulo theories, by building upon recent advances in reactive synthesis modulo theories. This allowed us to develop a novel approach for generating shields conforming to complex safety specifications in these more expressive, logics. We evaluated our shields and demonstrate their ability to handle rich data with temporal dynamics. To the best of our knowledge, this is the first approach for synthesizing shields for such expressivity.
title Shield Synthesis for LTL Modulo Theories
topic Logic in Computer Science
Artificial Intelligence
Machine Learning
Robotics
url https://arxiv.org/abs/2406.04184