Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jawaid, Mohsi, Elms, Ethan, Latif, Yasir, Chin, Tat-Jun
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914990399684608
author Jawaid, Mohsi
Elms, Ethan
Latif, Yasir
Chin, Tat-Jun
author_facet Jawaid, Mohsi
Elms, Ethan
Latif, Yasir
Chin, Tat-Jun
contents Deep models trained using synthetic data require domain adaptation to bridge the gap between the simulation and target environments. State-of-the-art domain adaptation methods often demand sufficient amounts of (unlabelled) data from the target domain. However, this need is difficult to fulfil when the target domain is an extreme environment, such as space. In this paper, our target problem is close proximity satellite pose estimation, where it is costly to obtain images of satellites from actual rendezvous missions. We demonstrate that event sensing offers a promising solution to generalise from the simulation to the target domain under stark illumination differences. Our main contribution is an event-based satellite pose estimation technique, trained purely on synthetic event data with basic data augmentation to improve robustness against practical (noisy) event sensors. Underpinning our method is a novel dataset with carefully calibrated ground truth, comprising of real event data obtained by emulating satellite rendezvous scenarios in the lab under drastic lighting conditions. Results on the dataset showed that our event-based satellite pose estimation method, trained only on synthetic data without adaptation, could generalise to the target domain effectively.
format Preprint
id arxiv_https___arxiv_org_abs_2209_11945
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing
Jawaid, Mohsi
Elms, Ethan
Latif, Yasir
Chin, Tat-Jun
Computer Vision and Pattern Recognition
Robotics
Deep models trained using synthetic data require domain adaptation to bridge the gap between the simulation and target environments. State-of-the-art domain adaptation methods often demand sufficient amounts of (unlabelled) data from the target domain. However, this need is difficult to fulfil when the target domain is an extreme environment, such as space. In this paper, our target problem is close proximity satellite pose estimation, where it is costly to obtain images of satellites from actual rendezvous missions. We demonstrate that event sensing offers a promising solution to generalise from the simulation to the target domain under stark illumination differences. Our main contribution is an event-based satellite pose estimation technique, trained purely on synthetic event data with basic data augmentation to improve robustness against practical (noisy) event sensors. Underpinning our method is a novel dataset with carefully calibrated ground truth, comprising of real event data obtained by emulating satellite rendezvous scenarios in the lab under drastic lighting conditions. Results on the dataset showed that our event-based satellite pose estimation method, trained only on synthetic data without adaptation, could generalise to the target domain effectively.
title Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2209.11945