Saved in:
Bibliographic Details
Main Authors: Watson, Christopher, Alur, Rajeev, Gopinath, Divya, Mangal, Ravi, Pasareanu, Corina S.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.20942
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915265906737152
author Watson, Christopher
Alur, Rajeev
Gopinath, Divya
Mangal, Ravi
Pasareanu, Corina S.
author_facet Watson, Christopher
Alur, Rajeev
Gopinath, Divya
Mangal, Ravi
Pasareanu, Corina S.
contents Recent advances in deep learning have enabled the development of autonomous systems that use deep neural networks for perception. Formal verification of these systems is challenging due to the size and complexity of the perception DNNs as well as hard-to-quantify, changing environment conditions. To address these challenges, we propose a probabilistic verification framework for autonomous systems based on the following key concepts: (1) Scenario-based Modeling: We decompose the task (e.g., car navigation) into a composition of scenarios, each representing a different environment condition. (2) Probabilistic Abstractions: For each scenario, we build a compact abstraction of perception based on the DNN's performance on an offline dataset that represents the scenario's environment condition. (3) Symbolic Reasoning and Acceleration: The abstractions enable efficient compositional verification of the autonomous system via symbolic reasoning and a novel acceleration proof rule that bounds the error probability of the system under arbitrary variations of environment conditions. We illustrate our approach on two case studies: an experimental autonomous system that guides airplanes on taxiways using high-dimensional perception DNNs and a simulation model of an F1Tenth autonomous car using LiDAR observations.
format Preprint
id arxiv_https___arxiv_org_abs_2504_20942
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Scenario-based Compositional Verification of Autonomous Systems with Neural Perception
Watson, Christopher
Alur, Rajeev
Gopinath, Divya
Mangal, Ravi
Pasareanu, Corina S.
Machine Learning
Robotics
Recent advances in deep learning have enabled the development of autonomous systems that use deep neural networks for perception. Formal verification of these systems is challenging due to the size and complexity of the perception DNNs as well as hard-to-quantify, changing environment conditions. To address these challenges, we propose a probabilistic verification framework for autonomous systems based on the following key concepts: (1) Scenario-based Modeling: We decompose the task (e.g., car navigation) into a composition of scenarios, each representing a different environment condition. (2) Probabilistic Abstractions: For each scenario, we build a compact abstraction of perception based on the DNN's performance on an offline dataset that represents the scenario's environment condition. (3) Symbolic Reasoning and Acceleration: The abstractions enable efficient compositional verification of the autonomous system via symbolic reasoning and a novel acceleration proof rule that bounds the error probability of the system under arbitrary variations of environment conditions. We illustrate our approach on two case studies: an experimental autonomous system that guides airplanes on taxiways using high-dimensional perception DNNs and a simulation model of an F1Tenth autonomous car using LiDAR observations.
title Scenario-based Compositional Verification of Autonomous Systems with Neural Perception
topic Machine Learning
Robotics
url https://arxiv.org/abs/2504.20942