HGIC: A Hand Gesture Based Interactive Control System for Efficient and Scalable Multi-UAV Operations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Mengsha, Li, Jinzhou, Jin, Runxiang, Shi, Chao, Xu, Lei, Liu, Rui
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913258355556352
author Hu, Mengsha
Li, Jinzhou
Jin, Runxiang
Shi, Chao
Xu, Lei
Liu, Rui
author_facet Hu, Mengsha
Li, Jinzhou
Jin, Runxiang
Shi, Chao
Xu, Lei
Liu, Rui
contents As technological advancements continue to expand the capabilities of multi unmanned-aerial-vehicle systems (mUAV), human operators face challenges in scalability and efficiency due to the complex cognitive load and operations associated with motion adjustments and team coordination. Such cognitive demands limit the feasible size of mUAV teams and necessitate extensive operator training, impeding broader adoption. This paper developed a Hand Gesture Based Interactive Control (HGIC), a novel interface system that utilize computer vision techniques to intuitively translate hand gestures into modular commands for robot teaming. Through learning control models, these commands enable efficient and scalable mUAV motion control and adjustments. HGIC eliminates the need for specialized hardware and offers two key benefits: 1) Minimal training requirements through natural gestures; and 2) Enhanced scalability and efficiency via adaptable commands. By reducing the cognitive burden on operators, HGIC opens the door for more effective large-scale mUAV applications in complex, dynamic, and uncertain scenarios. HGIC will be open-sourced after the paper being published online for the research community, aiming to drive forward innovations in human-mUAV interactions.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05478
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HGIC: A Hand Gesture Based Interactive Control System for Efficient and Scalable Multi-UAV Operations
Hu, Mengsha
Li, Jinzhou
Jin, Runxiang
Shi, Chao
Xu, Lei
Liu, Rui
Robotics
As technological advancements continue to expand the capabilities of multi unmanned-aerial-vehicle systems (mUAV), human operators face challenges in scalability and efficiency due to the complex cognitive load and operations associated with motion adjustments and team coordination. Such cognitive demands limit the feasible size of mUAV teams and necessitate extensive operator training, impeding broader adoption. This paper developed a Hand Gesture Based Interactive Control (HGIC), a novel interface system that utilize computer vision techniques to intuitively translate hand gestures into modular commands for robot teaming. Through learning control models, these commands enable efficient and scalable mUAV motion control and adjustments. HGIC eliminates the need for specialized hardware and offers two key benefits: 1) Minimal training requirements through natural gestures; and 2) Enhanced scalability and efficiency via adaptable commands. By reducing the cognitive burden on operators, HGIC opens the door for more effective large-scale mUAV applications in complex, dynamic, and uncertain scenarios. HGIC will be open-sourced after the paper being published online for the research community, aiming to drive forward innovations in human-mUAV interactions.
title HGIC: A Hand Gesture Based Interactive Control System for Efficient and Scalable Multi-UAV Operations
topic Robotics
url https://arxiv.org/abs/2403.05478