MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Renzhi, Zhou, Zhehua, Song, Jiayang, Xie, Xuan, Xie, Xiaofei, Ma, Lei
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916349926703104
author Wang, Renzhi
Zhou, Zhehua
Song, Jiayang
Xie, Xuan
Xie, Xiaofei
Ma, Lei
author_facet Wang, Renzhi
Zhou, Zhehua
Song, Jiayang
Xie, Xuan
Xie, Xiaofei
Ma, Lei
contents Cyber-Physical Systems (CPSs) are increasingly prevalent across various industrial and daily-life domains, with applications ranging from robotic operations to autonomous driving. With recent advancements in artificial intelligence (AI), learning-based components, especially AI controllers, have become essential in enhancing the functionality and efficiency of CPSs. However, the lack of interpretability in these AI controllers presents challenges to the safety and quality assurance of AI-enabled CPSs (AI-CPSs). Existing methods for improving the safety of AI controllers often involve neural network repair, which requires retraining with additional adversarial examples or access to detailed internal information of the neural network. Hence, these approaches have limited applicability for black-box policies, where only the inputs and outputs are accessible during operation. To overcome this, we propose MORTAR, a runtime action repair framework designed for AI-CPSs in this work. MORTAR begins by constructing a prediction model that forecasts the quality of actions proposed by the AI controller. If an unsafe action is detected, MORTAR then initiates a repair process to correct it. The generation of repaired actions is achieved through an optimization process guided by the safety estimates from the prediction model. We evaluate the effectiveness of MORTAR across various CPS tasks and AI controllers. The results demonstrate that MORTAR can efficiently improve task completion rates of AI controllers under specified safety specifications. Meanwhile, it also maintains minimal computational overhead, ensuring real-time operation of the AI-CPSs.
format Preprint
id arxiv_https___arxiv_org_abs_2408_03892
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems
Wang, Renzhi
Zhou, Zhehua
Song, Jiayang
Xie, Xuan
Xie, Xiaofei
Ma, Lei
Software Engineering
Artificial Intelligence
Cyber-Physical Systems (CPSs) are increasingly prevalent across various industrial and daily-life domains, with applications ranging from robotic operations to autonomous driving. With recent advancements in artificial intelligence (AI), learning-based components, especially AI controllers, have become essential in enhancing the functionality and efficiency of CPSs. However, the lack of interpretability in these AI controllers presents challenges to the safety and quality assurance of AI-enabled CPSs (AI-CPSs). Existing methods for improving the safety of AI controllers often involve neural network repair, which requires retraining with additional adversarial examples or access to detailed internal information of the neural network. Hence, these approaches have limited applicability for black-box policies, where only the inputs and outputs are accessible during operation. To overcome this, we propose MORTAR, a runtime action repair framework designed for AI-CPSs in this work. MORTAR begins by constructing a prediction model that forecasts the quality of actions proposed by the AI controller. If an unsafe action is detected, MORTAR then initiates a repair process to correct it. The generation of repaired actions is achieved through an optimization process guided by the safety estimates from the prediction model. We evaluate the effectiveness of MORTAR across various CPS tasks and AI controllers. The results demonstrate that MORTAR can efficiently improve task completion rates of AI controllers under specified safety specifications. Meanwhile, it also maintains minimal computational overhead, ensuring real-time operation of the AI-CPSs.
title MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2408.03892