MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems
MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems
This website provides the supplementary materials for the paper "MORTAR: A Model-based Runtime Action Repair Framework for AI-enabled Cyber-Physical Systems," The source code is available in the repository: https://anonymous.4open.science/r/mortar-2118/
The website is organized as follows:
Home page: The motivation why the safety analysis for industrial-level AI-enabled CPS is urgently needed.
Studied tasks: This page contains the study tasks we perform experiments on.
Experiment Setting: We gives details on the experimental evaluations on the proposed safety analysis frameworkÂ
RQ1: To what extent can the prediction model accurately predict the system safety
RQ2: How well does MORTAR perform in the studied CPS
RQ3: How do different optimization algorithms impact the performance of MORTAR?
Cyber-Physical Systems (CPSs) are increasingly prevalent across various industrial and daily-life domains, with applications ranging from robotic operations to autonomous driving. With recent advancements in artificial intelligence (AI), learning-based components, especially AI controllers, have become essential in enhancing the functionality and efficiency of CPSs. However, the lack of interpretability in these AI controllers presents challenges to the safety and quality assurance of AI-enabled CPSs (AI-CPSs). Existing methods for improving the safety of AI controllers often involve neural network repair, which requires retraining with additional adversarial examples or access to detailed internal information of the neural network. Hence, these approaches have limited applicability for black-box policies, where only the inputs and outputs are accessible during operation. To overcome this, we propose MORTAR, a runtime action repair framework designed for AI-CPSs in this work. MORTAR begins by constructing a prediction model that forecasts the quality of actions proposed by the AI controller. If an unsafe action is detected, MORTAR then initiates a repair process to correct it. The generation of repaired actions is achieved through an optimization process guided by the safety estimates from the prediction model. We evaluate the effectiveness of MORTAR across various CPS tasks and AI controllers. The results demonstrate that MORTAR can efficiently improve task completion rates of AI controllers under specified safety specifications. Meanwhile, it also maintains minimal computational overhead, ensuring real-time operation of the AI-CPSs.
Workflow summary of Model-based Safety Analysis for AI-enabled CPS, and high-level empirical study design