Automated Behaviour-Driven Acceptance Testing of Robotic Systems

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nguyen, Minh, Wrede, Sebastian, Hochgeschwender, Nico
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912469045215232
author Nguyen, Minh
Wrede, Sebastian
Hochgeschwender, Nico
author_facet Nguyen, Minh
Wrede, Sebastian
Hochgeschwender, Nico
contents The specification and validation of robotics applications require bridging the gap between formulating requirements and systematic testing. This often involves manual and error-prone tasks that become more complex as requirements, design, and implementation evolve. To address this challenge systematically, we propose extending behaviour-driven development (BDD) to define and verify acceptance criteria for robotic systems. In this context, we use domain-specific modelling and represent composable BDD models as knowledge graphs for robust querying and manipulation, facilitating the generation of executable testing models. A domain-specific language helps to efficiently specify robotic acceptance criteria. We explore the potential for automated generation and execution of acceptance tests through a software architecture that integrates a BDD framework, Isaac Sim, and model transformations, focusing on acceptance criteria for pick-and-place applications. We tested this architecture with an existing pick-and-place implementation and evaluated the execution results, which shows how this application behaves and fails differently when tested against variations of the agent and environment. This research advances the rigorous and automated evaluation of robotic systems, contributing to their reliability and trustworthiness.
format Preprint
id arxiv_https___arxiv_org_abs_2507_05125
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Automated Behaviour-Driven Acceptance Testing of Robotic Systems
Nguyen, Minh
Wrede, Sebastian
Hochgeschwender, Nico
Robotics
The specification and validation of robotics applications require bridging the gap between formulating requirements and systematic testing. This often involves manual and error-prone tasks that become more complex as requirements, design, and implementation evolve. To address this challenge systematically, we propose extending behaviour-driven development (BDD) to define and verify acceptance criteria for robotic systems. In this context, we use domain-specific modelling and represent composable BDD models as knowledge graphs for robust querying and manipulation, facilitating the generation of executable testing models. A domain-specific language helps to efficiently specify robotic acceptance criteria. We explore the potential for automated generation and execution of acceptance tests through a software architecture that integrates a BDD framework, Isaac Sim, and model transformations, focusing on acceptance criteria for pick-and-place applications. We tested this architecture with an existing pick-and-place implementation and evaluated the execution results, which shows how this application behaves and fails differently when tested against variations of the agent and environment. This research advances the rigorous and automated evaluation of robotic systems, contributing to their reliability and trustworthiness.
title Automated Behaviour-Driven Acceptance Testing of Robotic Systems
topic Robotics
url https://arxiv.org/abs/2507.05125