Deep Visual Servoing of an Aerial Robot Using Keypoint Feature Extraction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sepahvand, Shayan, Amiri, Niloufar, Janabi-Sharifi, Farrokh
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908955610972160
author Sepahvand, Shayan
Amiri, Niloufar
Janabi-Sharifi, Farrokh
author_facet Sepahvand, Shayan
Amiri, Niloufar
Janabi-Sharifi, Farrokh
contents The problem of image-based visual servoing (IBVS) of an aerial robot using deep-learning-based keypoint detection is addressed in this article. A monocular RGB camera mounted on the platform is utilized to collect the visual data. A convolutional neural network (CNN) is then employed to extract the features serving as the visual data for the servoing task. This paper contributes to the field by circumventing not only the challenge stemming from the need for man-made marker detection in conventional visual servoing techniques, but also enhancing the robustness against undesirable factors including occlusion, varying illumination, clutter, and background changes, thereby broadening the applicability of perception-guided motion control tasks in aerial robots. Additionally, extensive physics-based ROS Gazebo simulations are conducted to assess the effectiveness of this method, in contrast to many existing studies that rely solely on physics-less simulations. A demonstration video is available at https://youtu.be/Dd2Her8Ly-E.
format Preprint
id arxiv_https___arxiv_org_abs_2503_23171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep Visual Servoing of an Aerial Robot Using Keypoint Feature Extraction
Sepahvand, Shayan
Amiri, Niloufar
Janabi-Sharifi, Farrokh
Robotics
The problem of image-based visual servoing (IBVS) of an aerial robot using deep-learning-based keypoint detection is addressed in this article. A monocular RGB camera mounted on the platform is utilized to collect the visual data. A convolutional neural network (CNN) is then employed to extract the features serving as the visual data for the servoing task. This paper contributes to the field by circumventing not only the challenge stemming from the need for man-made marker detection in conventional visual servoing techniques, but also enhancing the robustness against undesirable factors including occlusion, varying illumination, clutter, and background changes, thereby broadening the applicability of perception-guided motion control tasks in aerial robots. Additionally, extensive physics-based ROS Gazebo simulations are conducted to assess the effectiveness of this method, in contrast to many existing studies that rely solely on physics-less simulations. A demonstration video is available at https://youtu.be/Dd2Her8Ly-E.
title Deep Visual Servoing of an Aerial Robot Using Keypoint Feature Extraction
topic Robotics
url https://arxiv.org/abs/2503.23171