Saved in:
Bibliographic Details
Main Authors: Dong, Shuyang, Ma, Meiyi, Lamp, Josephine, Elbaum, Sebastian, Dwyer, Matthew B., Feng, Lu
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.13365
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910751268012032
author Dong, Shuyang
Ma, Meiyi
Lamp, Josephine
Elbaum, Sebastian
Dwyer, Matthew B.
Feng, Lu
author_facet Dong, Shuyang
Ma, Meiyi
Lamp, Josephine
Elbaum, Sebastian
Dwyer, Matthew B.
Feng, Lu
contents There is a growing trend toward AI systems interacting with humans to revolutionize a range of application domains such as healthcare and transportation. However, unsafe human-machine interaction can lead to catastrophic failures. We propose a novel approach that predicts future states by accounting for the uncertainty of human interaction, monitors whether predictions satisfy or violate safety requirements, and adapts control actions based on the predictive monitoring results. Specifically, we develop a new quantitative predictive monitor based on Signal Temporal Logic with Uncertainty (STL-U) to compute a robustness degree interval, which indicates the extent to which a sequence of uncertain predictions satisfies or violates an STL-U requirement. We also develop a new loss function to guide the uncertainty calibration of Bayesian deep learning and a new adaptive control method, both of which leverage STL-U quantitative predictive monitoring results. We apply the proposed approach to two case studies: Type 1 Diabetes management and semi-autonomous driving. Experiments show that the proposed approach improves safety and effectiveness in both case studies.
format Preprint
id arxiv_https___arxiv_org_abs_2412_13365
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Quantitative Predictive Monitoring and Control for Safe Human-Machine Interaction
Dong, Shuyang
Ma, Meiyi
Lamp, Josephine
Elbaum, Sebastian
Dwyer, Matthew B.
Feng, Lu
Artificial Intelligence
Human-Computer Interaction
Systems and Control
There is a growing trend toward AI systems interacting with humans to revolutionize a range of application domains such as healthcare and transportation. However, unsafe human-machine interaction can lead to catastrophic failures. We propose a novel approach that predicts future states by accounting for the uncertainty of human interaction, monitors whether predictions satisfy or violate safety requirements, and adapts control actions based on the predictive monitoring results. Specifically, we develop a new quantitative predictive monitor based on Signal Temporal Logic with Uncertainty (STL-U) to compute a robustness degree interval, which indicates the extent to which a sequence of uncertain predictions satisfies or violates an STL-U requirement. We also develop a new loss function to guide the uncertainty calibration of Bayesian deep learning and a new adaptive control method, both of which leverage STL-U quantitative predictive monitoring results. We apply the proposed approach to two case studies: Type 1 Diabetes management and semi-autonomous driving. Experiments show that the proposed approach improves safety and effectiveness in both case studies.
title Quantitative Predictive Monitoring and Control for Safe Human-Machine Interaction
topic Artificial Intelligence
Human-Computer Interaction
Systems and Control
url https://arxiv.org/abs/2412.13365