A Systematic Digital Engineering Approach to Verification & Validation of Autonomous Ground Vehicles in Off-Road Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Samak, Tanmay Vilas, Samak, Chinmay Vilas, Brault, Julia, Harber, Cori, McCane, Kirsten, Smereka, Jonathon, Brudnak, Mark, Gorsich, David, Krovi, Venkat
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917179314667520
author Samak, Tanmay Vilas
Samak, Chinmay Vilas
Brault, Julia
Harber, Cori
McCane, Kirsten
Smereka, Jonathon
Brudnak, Mark
Gorsich, David
Krovi, Venkat
author_facet Samak, Tanmay Vilas
Samak, Chinmay Vilas
Brault, Julia
Harber, Cori
McCane, Kirsten
Smereka, Jonathon
Brudnak, Mark
Gorsich, David
Krovi, Venkat
contents The engineering community currently encounters significant challenges in the systematic development and validation of autonomy algorithms for off-road ground vehicles. These challenges are posed by unusually high test parameters and algorithmic variants. In order to address these pain points, this work presents an optimized digital engineering framework that tightly couples digital twin simulations with model-based systems engineering (MBSE) and model-based design (MBD) workflows. The efficacy of the proposed framework is demonstrated through an end-to-end case study of an autonomous light tactical vehicle (LTV) performing visual servoing to drive along a dirt road and reacting to any obstacles or environmental changes. The presented methodology allows for traceable requirements engineering, efficient variant management, granular parameter sweep setup, systematic test-case definition, and automated execution of the simulations. The candidate off-road autonomy algorithm is evaluated for satisfying requirements against a battery of 128 test cases, which is procedurally generated based on the test parameters (times of the day and weather conditions) and algorithmic variants (perception, planning, and control sub-systems). Finally, the test results and key performance indicators are logged, and the test report is generated automatically. This then allows for manual as well as automated data analysis with traceability and tractability across the digital thread.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13787
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Systematic Digital Engineering Approach to Verification & Validation of Autonomous Ground Vehicles in Off-Road Environments
Samak, Tanmay Vilas
Samak, Chinmay Vilas
Brault, Julia
Harber, Cori
McCane, Kirsten
Smereka, Jonathon
Brudnak, Mark
Gorsich, David
Krovi, Venkat
Robotics
The engineering community currently encounters significant challenges in the systematic development and validation of autonomy algorithms for off-road ground vehicles. These challenges are posed by unusually high test parameters and algorithmic variants. In order to address these pain points, this work presents an optimized digital engineering framework that tightly couples digital twin simulations with model-based systems engineering (MBSE) and model-based design (MBD) workflows. The efficacy of the proposed framework is demonstrated through an end-to-end case study of an autonomous light tactical vehicle (LTV) performing visual servoing to drive along a dirt road and reacting to any obstacles or environmental changes. The presented methodology allows for traceable requirements engineering, efficient variant management, granular parameter sweep setup, systematic test-case definition, and automated execution of the simulations. The candidate off-road autonomy algorithm is evaluated for satisfying requirements against a battery of 128 test cases, which is procedurally generated based on the test parameters (times of the day and weather conditions) and algorithmic variants (perception, planning, and control sub-systems). Finally, the test results and key performance indicators are logged, and the test report is generated automatically. This then allows for manual as well as automated data analysis with traceability and tractability across the digital thread.
title A Systematic Digital Engineering Approach to Verification & Validation of Autonomous Ground Vehicles in Off-Road Environments
topic Robotics
url https://arxiv.org/abs/2503.13787