An experimental evaluation of Siamese Neural Networks for robot localization using omnidirectional imaging in indoor environments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cabrera, J. J., Román, V., Gil, A., Reinoso, O., Payá, L.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913431358013440
author Cabrera, J. J.
Román, V.
Gil, A.
Reinoso, O.
Payá, L.
author_facet Cabrera, J. J.
Román, V.
Gil, A.
Reinoso, O.
Payá, L.
contents The objective of this paper is to address the localization problem using omnidirectional images captured by a catadioptric vision system mounted on the robot. For this purpose, we explore the potential of Siamese Neural Networks for modeling indoor environments using panoramic images as the unique source of information. Siamese Neural Networks are characterized by their ability to generate a similarity function between two input data, in this case, between two panoramic images. In this study, Siamese Neural Networks composed of two Convolutional Neural Networks (CNNs) are used. The output of each CNN is a descriptor which is used to characterize each image. The dissimilarity of the images is computed by measuring the distance between these descriptors. This fact makes Siamese Neural Networks particularly suitable to perform image retrieval tasks. First, we evaluate an initial task strongly related to localization that consists in detecting whether two images have been captured in the same or in different rooms. Next, we assess Siamese Neural Networks in the context of a global localization problem. The results outperform previous techniques for solving the localization task using the COLD-Freiburg dataset, in a variety of lighting conditions, specially when using images captured in cloudy and night conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10536
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An experimental evaluation of Siamese Neural Networks for robot localization using omnidirectional imaging in indoor environments
Cabrera, J. J.
Román, V.
Gil, A.
Reinoso, O.
Payá, L.
Computer Vision and Pattern Recognition
Artificial Intelligence
The objective of this paper is to address the localization problem using omnidirectional images captured by a catadioptric vision system mounted on the robot. For this purpose, we explore the potential of Siamese Neural Networks for modeling indoor environments using panoramic images as the unique source of information. Siamese Neural Networks are characterized by their ability to generate a similarity function between two input data, in this case, between two panoramic images. In this study, Siamese Neural Networks composed of two Convolutional Neural Networks (CNNs) are used. The output of each CNN is a descriptor which is used to characterize each image. The dissimilarity of the images is computed by measuring the distance between these descriptors. This fact makes Siamese Neural Networks particularly suitable to perform image retrieval tasks. First, we evaluate an initial task strongly related to localization that consists in detecting whether two images have been captured in the same or in different rooms. Next, we assess Siamese Neural Networks in the context of a global localization problem. The results outperform previous techniques for solving the localization task using the COLD-Freiburg dataset, in a variety of lighting conditions, specially when using images captured in cloudy and night conditions.
title An experimental evaluation of Siamese Neural Networks for robot localization using omnidirectional imaging in indoor environments
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2407.10536