Automated System-level Testing of Unmanned Aerial Systems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sartaj, Hassan, Muqeet, Asmar, Iqbal, Muhammad Zohaib, Khan, Muhammad Uzair
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909277065576448
author Sartaj, Hassan
Muqeet, Asmar
Iqbal, Muhammad Zohaib
Khan, Muhammad Uzair
author_facet Sartaj, Hassan
Muqeet, Asmar
Iqbal, Muhammad Zohaib
Khan, Muhammad Uzair
contents Unmanned aerial systems (UAS) rely on various avionics systems that are safety-critical and mission-critical. A major requirement of international safety standards is to perform rigorous system-level testing of avionics software systems. The current industrial practice is to manually create test scenarios, manually/automatically execute these scenarios using simulators, and manually evaluate outcomes. The test scenarios typically consist of setting certain flight or environment conditions and testing the system under test in these settings. The state-of-the-art approaches for this purpose also require manual test scenario development and evaluation. In this paper, we propose a novel approach to automate the system-level testing of the UAS. The proposed approach (AITester) utilizes model-based testing and artificial intelligence (AI) techniques to automatically generate, execute, and evaluate various test scenarios. The test scenarios are generated on the fly, i.e., during test execution based on the environmental context at runtime. The approach is supported by a toolset. We empirically evaluate the proposed approach on two core components of UAS, an autopilot system of an unmanned aerial vehicle (UAV) and cockpit display systems (CDS) of the ground control station (GCS). The results show that the AITester effectively generates test scenarios causing deviations from the expected behavior of the UAV autopilot and reveals potential flaws in the GCS-CDS.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15857
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automated System-level Testing of Unmanned Aerial Systems
Sartaj, Hassan
Muqeet, Asmar
Iqbal, Muhammad Zohaib
Khan, Muhammad Uzair
Software Engineering
Artificial Intelligence
Robotics
Unmanned aerial systems (UAS) rely on various avionics systems that are safety-critical and mission-critical. A major requirement of international safety standards is to perform rigorous system-level testing of avionics software systems. The current industrial practice is to manually create test scenarios, manually/automatically execute these scenarios using simulators, and manually evaluate outcomes. The test scenarios typically consist of setting certain flight or environment conditions and testing the system under test in these settings. The state-of-the-art approaches for this purpose also require manual test scenario development and evaluation. In this paper, we propose a novel approach to automate the system-level testing of the UAS. The proposed approach (AITester) utilizes model-based testing and artificial intelligence (AI) techniques to automatically generate, execute, and evaluate various test scenarios. The test scenarios are generated on the fly, i.e., during test execution based on the environmental context at runtime. The approach is supported by a toolset. We empirically evaluate the proposed approach on two core components of UAS, an autopilot system of an unmanned aerial vehicle (UAV) and cockpit display systems (CDS) of the ground control station (GCS). The results show that the AITester effectively generates test scenarios causing deviations from the expected behavior of the UAV autopilot and reveals potential flaws in the GCS-CDS.
title Automated System-level Testing of Unmanned Aerial Systems
topic Software Engineering
Artificial Intelligence
Robotics
url https://arxiv.org/abs/2403.15857