Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ramezani, Zahra, Šehić, Kenan, Nardi, Luigi, Åkesson, Knut
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:https://arxiv.org/abs/2209.06735
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912230033850368
author Ramezani, Zahra
Šehić, Kenan
Nardi, Luigi
Åkesson, Knut
author_facet Ramezani, Zahra
Šehić, Kenan
Nardi, Luigi
Åkesson, Knut
contents Cyber-physical systems (CPSs) are often complex and safety-critical, making it both challenging and crucial to ensure that the system's specifications are met. Simulation-based falsification is a practical testing technique for increasing confidence in a CPS's correctness, as it only requires that the system be simulated. Reducing the number of computationally intensive simulations needed for falsification is a key concern. In this study, we investigate Bayesian optimization (BO), a sample-efficient approach that learns a surrogate model to capture the relationship between input signal parameterization and specification evaluation. We propose two enhancements to the basic BO for improving falsification: (1) leveraging local surrogate models, and (2) utilizing the user's prior knowledge. Additionally, we address the formulation of acquisition functions for falsification by proposing and evaluating various alternatives. Our benchmark evaluation demonstrates significant improvements when using local surrogate models in BO for falsifying challenging benchmark examples. Incorporating prior knowledge is found to be especially beneficial when the simulation budget is constrained. For some benchmark problems, the choice of acquisition function noticeably impacts the number of simulations required for successful falsification.
format Preprint
id arxiv_https___arxiv_org_abs_2209_06735
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Falsification of Cyber-Physical Systems using Bayesian Optimization
Ramezani, Zahra
Šehić, Kenan
Nardi, Luigi
Åkesson, Knut
Systems and Control
Machine Learning
Cyber-physical systems (CPSs) are often complex and safety-critical, making it both challenging and crucial to ensure that the system's specifications are met. Simulation-based falsification is a practical testing technique for increasing confidence in a CPS's correctness, as it only requires that the system be simulated. Reducing the number of computationally intensive simulations needed for falsification is a key concern. In this study, we investigate Bayesian optimization (BO), a sample-efficient approach that learns a surrogate model to capture the relationship between input signal parameterization and specification evaluation. We propose two enhancements to the basic BO for improving falsification: (1) leveraging local surrogate models, and (2) utilizing the user's prior knowledge. Additionally, we address the formulation of acquisition functions for falsification by proposing and evaluating various alternatives. Our benchmark evaluation demonstrates significant improvements when using local surrogate models in BO for falsifying challenging benchmark examples. Incorporating prior knowledge is found to be especially beneficial when the simulation budget is constrained. For some benchmark problems, the choice of acquisition function noticeably impacts the number of simulations required for successful falsification.
title Falsification of Cyber-Physical Systems using Bayesian Optimization
topic Systems and Control
Machine Learning
url https://arxiv.org/abs/2209.06735