Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Innes, Craig, Ramamoorthy, Subramanian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916334768488448
author Innes, Craig
Ramamoorthy, Subramanian
author_facet Innes, Craig
Ramamoorthy, Subramanian
contents Autonomous Vehicles (AVs) are often tested in simulation to estimate the probability they will violate safety specifications. Two common issues arise when using existing techniques to produce this estimation: If violations occur rarely, simple Monte-Carlo sampling techniques can fail to produce efficient estimates; if simulation horizons are too long, importance sampling techniques (which learn proposal distributions from past simulations) can fail to converge. This paper addresses both issues by interleaving rare-event sampling techniques with online specification monitoring algorithms. We use adaptive multi-level splitting to decompose simulations into partial trajectories, then calculate the distance of those partial trajectories to failure by leveraging robustness metrics from Signal Temporal Logic (STL). By caching those partial robustness metric values, we can efficiently re-use computations across multiple sampling stages. Our experiments on an interstate lane-change scenario show our method is viable for testing simulated AV-pipelines, efficiently estimating failure probabilities for STL specifications based on real traffic rules. We produce better estimates than Monte-Carlo and importance sampling in fewer simulations.
format Preprint
id arxiv_https___arxiv_org_abs_2405_15771
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations
Innes, Craig
Ramamoorthy, Subramanian
Robotics
Artificial Intelligence
Machine Learning
Autonomous Vehicles (AVs) are often tested in simulation to estimate the probability they will violate safety specifications. Two common issues arise when using existing techniques to produce this estimation: If violations occur rarely, simple Monte-Carlo sampling techniques can fail to produce efficient estimates; if simulation horizons are too long, importance sampling techniques (which learn proposal distributions from past simulations) can fail to converge. This paper addresses both issues by interleaving rare-event sampling techniques with online specification monitoring algorithms. We use adaptive multi-level splitting to decompose simulations into partial trajectories, then calculate the distance of those partial trajectories to failure by leveraging robustness metrics from Signal Temporal Logic (STL). By caching those partial robustness metric values, we can efficiently re-use computations across multiple sampling stages. Our experiments on an interstate lane-change scenario show our method is viable for testing simulated AV-pipelines, efficiently estimating failure probabilities for STL specifications based on real traffic rules. We produce better estimates than Monte-Carlo and importance sampling in fewer simulations.
title Adaptive Splitting of Reusable Temporal Monitors for Rare Traffic Violations
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2405.15771