Proximal Control of UAVs with Federated Learning for Human-Robot Collaborative Domains

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Nobrega, Lucas Nogueira, de Oliveira, Ewerton, Saska, Martin, Nascimento, Tiago
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909659452932096
author Nobrega, Lucas Nogueira
de Oliveira, Ewerton
Saska, Martin
Nascimento, Tiago
author_facet Nobrega, Lucas Nogueira
de Oliveira, Ewerton
Saska, Martin
Nascimento, Tiago
contents The human-robot interaction (HRI) is a growing area of research. In HRI, complex command (action) classification is still an open problem that usually prevents the real applicability of such a technique. The literature presents some works that use neural networks to detect these actions. However, occlusion is still a major issue in HRI, especially when using uncrewed aerial vehicles (UAVs), since, during the robot's movement, the human operator is often out of the robot's field of view. Furthermore, in multi-robot scenarios, distributed training is also an open problem. In this sense, this work proposes an action recognition and control approach based on Long Short-Term Memory (LSTM) Deep Neural Networks with two layers in association with three densely connected layers and Federated Learning (FL) embedded in multiple drones. The FL enabled our approach to be trained in a distributed fashion, i.e., access to data without the need for cloud or other repositories, which facilitates the multi-robot system's learning. Furthermore, our multi-robot approach results also prevented occlusion situations, with experiments with real robots achieving an accuracy greater than 96%.
format Preprint
id arxiv_https___arxiv_org_abs_2412_02863
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Proximal Control of UAVs with Federated Learning for Human-Robot Collaborative Domains
Nobrega, Lucas Nogueira
de Oliveira, Ewerton
Saska, Martin
Nascimento, Tiago
Robotics
Artificial Intelligence
Machine Learning
The human-robot interaction (HRI) is a growing area of research. In HRI, complex command (action) classification is still an open problem that usually prevents the real applicability of such a technique. The literature presents some works that use neural networks to detect these actions. However, occlusion is still a major issue in HRI, especially when using uncrewed aerial vehicles (UAVs), since, during the robot's movement, the human operator is often out of the robot's field of view. Furthermore, in multi-robot scenarios, distributed training is also an open problem. In this sense, this work proposes an action recognition and control approach based on Long Short-Term Memory (LSTM) Deep Neural Networks with two layers in association with three densely connected layers and Federated Learning (FL) embedded in multiple drones. The FL enabled our approach to be trained in a distributed fashion, i.e., access to data without the need for cloud or other repositories, which facilitates the multi-robot system's learning. Furthermore, our multi-robot approach results also prevented occlusion situations, with experiments with real robots achieving an accuracy greater than 96%.
title Proximal Control of UAVs with Federated Learning for Human-Robot Collaborative Domains
topic Robotics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2412.02863