Saved in:
Bibliographic Details
Main Authors: Keno, Hambisa, Pioch, Nicholas J., Guagliano, Christopher, Chung, Timothy H.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.06608
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929494781067264
author Keno, Hambisa
Pioch, Nicholas J.
Guagliano, Christopher
Chung, Timothy H.
author_facet Keno, Hambisa
Pioch, Nicholas J.
Guagliano, Christopher
Chung, Timothy H.
contents Application of Unmanned Aerial Vehicles (UAVs) in search and rescue, emergency management, and law enforcement has gained traction with the advent of low-cost platforms and sensor payloads. The emergence of hybrid neural and symbolic AI approaches for complex reasoning is expected to further push the boundaries of these applications with decreasing levels of human intervention. However, current UAV simulation environments lack semantic context suited to this hybrid approach. To address this gap, HAMERITT (Hybrid Ai Mission Environment for RapId Training and Testing) provides a simulation-based autonomy software framework that supports the training, testing and assurance of neuro-symbolic algorithms for autonomous maneuver and perception reasoning. HAMERITT includes scenario generation capabilities that offer mission-relevant contextual symbolic information in addition to raw sensor data. Scenarios include symbolic descriptions for entities of interest and their relations to scene elements, as well as spatial-temporal constraints in the form of time-bounded areas of interest with prior probabilities and restricted zones within those areas. HAMERITT also features support for training distinct algorithm threads for maneuver vs. perception within an end-to-end mission run. Future work includes improving scenario realism and scaling symbolic context generation through automated workflow.
format Preprint
id arxiv_https___arxiv_org_abs_2409_06608
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Simulation-based Scenario Generation for Robust Hybrid AI for Autonomy
Keno, Hambisa
Pioch, Nicholas J.
Guagliano, Christopher
Chung, Timothy H.
Robotics
Artificial Intelligence
68T20, 68T45, 68T40
J.7; C.3
Application of Unmanned Aerial Vehicles (UAVs) in search and rescue, emergency management, and law enforcement has gained traction with the advent of low-cost platforms and sensor payloads. The emergence of hybrid neural and symbolic AI approaches for complex reasoning is expected to further push the boundaries of these applications with decreasing levels of human intervention. However, current UAV simulation environments lack semantic context suited to this hybrid approach. To address this gap, HAMERITT (Hybrid Ai Mission Environment for RapId Training and Testing) provides a simulation-based autonomy software framework that supports the training, testing and assurance of neuro-symbolic algorithms for autonomous maneuver and perception reasoning. HAMERITT includes scenario generation capabilities that offer mission-relevant contextual symbolic information in addition to raw sensor data. Scenarios include symbolic descriptions for entities of interest and their relations to scene elements, as well as spatial-temporal constraints in the form of time-bounded areas of interest with prior probabilities and restricted zones within those areas. HAMERITT also features support for training distinct algorithm threads for maneuver vs. perception within an end-to-end mission run. Future work includes improving scenario realism and scaling symbolic context generation through automated workflow.
title Simulation-based Scenario Generation for Robust Hybrid AI for Autonomy
topic Robotics
Artificial Intelligence
68T20, 68T45, 68T40
J.7; C.3
url https://arxiv.org/abs/2409.06608