ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2021
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929559259054080 |
|---|---|
| author | Rondao, Duarte Aouf, Nabil Richardson, Mark A. |
| author_facet | Rondao, Duarte Aouf, Nabil Richardson, Mark A. |
| contents | This paper presents an innovative deep learning pipeline which estimates the relative pose of a spacecraft by incorporating the temporal information from a rendezvous sequence. It leverages the performance of long short-term memory (LSTM) units in modelling sequences of data for the processing of features extracted by a convolutional neural network (CNN) backbone. Three distinct training strategies, which follow a coarse-to-fine funnelled approach, are combined to facilitate feature learning and improve end-to-end pose estimation by regression. The capability of CNNs to autonomously ascertain feature representations from images is exploited to fuse thermal infrared data with red-green-blue (RGB) inputs, thus mitigating the effects of artefacts from imaging space objects in the visible wavelength. Each contribution of the proposed framework, dubbed ChiNet, is demonstrated on a synthetic dataset, and the complete pipeline is validated on experimental data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2108_10282 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation Rondao, Duarte Aouf, Nabil Richardson, Mark A. Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing This paper presents an innovative deep learning pipeline which estimates the relative pose of a spacecraft by incorporating the temporal information from a rendezvous sequence. It leverages the performance of long short-term memory (LSTM) units in modelling sequences of data for the processing of features extracted by a convolutional neural network (CNN) backbone. Three distinct training strategies, which follow a coarse-to-fine funnelled approach, are combined to facilitate feature learning and improve end-to-end pose estimation by regression. The capability of CNNs to autonomously ascertain feature representations from images is exploited to fuse thermal infrared data with red-green-blue (RGB) inputs, thus mitigating the effects of artefacts from imaging space objects in the visible wavelength. Each contribution of the proposed framework, dubbed ChiNet, is demonstrated on a synthetic dataset, and the complete pipeline is validated on experimental data. |
| title | ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing |
| url | https://arxiv.org/abs/2108.10282 |