Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Berra, Andrea, Sankaranarayanan, Viswa Narayanan, Seisa, Achilleas Santi, Mellet, Julien, Gamage, Udayanga G. W. K. N., Satpute, Sumeet Gajanan, Ruggiero, Fabio, Lippiello, Vincenzo, Tolu, Silvia, Fumagalli, Matteo, Nikolakopoulos, George, Soto, Miguel Ángel Trujillo, Heredia, Guillermo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912079570534400
author Berra, Andrea
Sankaranarayanan, Viswa Narayanan
Seisa, Achilleas Santi
Mellet, Julien
Gamage, Udayanga G. W. K. N.
Satpute, Sumeet Gajanan
Ruggiero, Fabio
Lippiello, Vincenzo
Tolu, Silvia
Fumagalli, Matteo
Nikolakopoulos, George
Soto, Miguel Ángel Trujillo
Heredia, Guillermo
author_facet Berra, Andrea
Sankaranarayanan, Viswa Narayanan
Seisa, Achilleas Santi
Mellet, Julien
Gamage, Udayanga G. W. K. N.
Satpute, Sumeet Gajanan
Ruggiero, Fabio
Lippiello, Vincenzo
Tolu, Silvia
Fumagalli, Matteo
Nikolakopoulos, George
Soto, Miguel Ángel Trujillo
Heredia, Guillermo
contents The paper introduces a novel framework for safe and autonomous aerial physical interaction in industrial settings. It comprises two main components: a neural network-based target detection system enhanced with edge computing for reduced onboard computational load, and a control barrier function (CBF)-based controller for safe and precise maneuvering. The target detection system is trained on a dataset under challenging visual conditions and evaluated for accuracy across various unseen data with changing lighting conditions. Depth features are utilized for target pose estimation, with the entire detection framework offloaded into low-latency edge computing. The CBF-based controller enables the UAV to converge safely to the target for precise contact. Simulated evaluations of both the controller and target detection are presented, alongside an analysis of real-world detection performance.
format Preprint
id arxiv_https___arxiv_org_abs_2410_15802
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers
Berra, Andrea
Sankaranarayanan, Viswa Narayanan
Seisa, Achilleas Santi
Mellet, Julien
Gamage, Udayanga G. W. K. N.
Satpute, Sumeet Gajanan
Ruggiero, Fabio
Lippiello, Vincenzo
Tolu, Silvia
Fumagalli, Matteo
Nikolakopoulos, George
Soto, Miguel Ángel Trujillo
Heredia, Guillermo
Robotics
Computer Vision and Pattern Recognition
Systems and Control
The paper introduces a novel framework for safe and autonomous aerial physical interaction in industrial settings. It comprises two main components: a neural network-based target detection system enhanced with edge computing for reduced onboard computational load, and a control barrier function (CBF)-based controller for safe and precise maneuvering. The target detection system is trained on a dataset under challenging visual conditions and evaluated for accuracy across various unseen data with changing lighting conditions. Depth features are utilized for target pose estimation, with the entire detection framework offloaded into low-latency edge computing. The CBF-based controller enables the UAV to converge safely to the target for precise contact. Simulated evaluations of both the controller and target detection are presented, alongside an analysis of real-world detection performance.
title Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers
topic Robotics
Computer Vision and Pattern Recognition
Systems and Control
url https://arxiv.org/abs/2410.15802