Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wickramasuriya, Maneesha, Lee, Taeyoung, Snyder, Murray
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910007888445440
author Wickramasuriya, Maneesha
Lee, Taeyoung
Snyder, Murray
author_facet Wickramasuriya, Maneesha
Lee, Taeyoung
Snyder, Murray
contents This paper introduces a deep transformer network for estimating the relative 6D pose of a Unmanned Aerial Vehicle (UAV) with respect to a ship using monocular images. A synthetic dataset of ship images is created and annotated with 2D keypoints of multiple ship parts. A Transformer Neural Network model is trained to detect these keypoints and estimate the 6D pose of each part. The estimates are integrated using Bayesian fusion. The model is tested on synthetic data and in-situ flight experiments, demonstrating robustness and accuracy in various lighting conditions. The position estimation error is approximately 0.8\% and 1.0\% of the distance to the ship for the synthetic data and the flight experiments, respectively. The method has potential applications for ship-based autonomous UAV landing and navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2406_09260
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle
Wickramasuriya, Maneesha
Lee, Taeyoung
Snyder, Murray
Computer Vision and Pattern Recognition
Artificial Intelligence
Robotics
Image and Video Processing
This paper introduces a deep transformer network for estimating the relative 6D pose of a Unmanned Aerial Vehicle (UAV) with respect to a ship using monocular images. A synthetic dataset of ship images is created and annotated with 2D keypoints of multiple ship parts. A Transformer Neural Network model is trained to detect these keypoints and estimate the 6D pose of each part. The estimates are integrated using Bayesian fusion. The model is tested on synthetic data and in-situ flight experiments, demonstrating robustness and accuracy in various lighting conditions. The position estimation error is approximately 0.8\% and 1.0\% of the distance to the ship for the synthetic data and the flight experiments, respectively. The method has potential applications for ship-based autonomous UAV landing and navigation.
title Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Robotics
Image and Video Processing
url https://arxiv.org/abs/2406.09260