Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Antonazzi, Michele, Luperto, Matteo, Borghese, N. Alberto, Basilico, Nicola
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917021805969408
author Antonazzi, Michele
Luperto, Matteo
Borghese, N. Alberto
Basilico, Nicola
author_facet Antonazzi, Michele
Luperto, Matteo
Borghese, N. Alberto
Basilico, Nicola
contents Mobile service robots are increasingly prevalent in human-centric, real-world domains, operating autonomously in unconstrained indoor environments. In such a context, robotic vision plays a central role in enabling service robots to perceive high-level environmental features from visual observations. Despite the data-driven approaches based on deep learning push the boundaries of vision systems, applying these techniques to real-world robotic scenarios presents unique methodological challenges. Traditional models fail to represent the challenging perception constraints typical of service robots and must be adapted for the specific environment where robots finally operate. We propose a method leveraging photorealistic simulations that balances data quality and acquisition costs for synthesizing visual datasets from the robot perspective used to train deep architectures. Then, we show the benefits in qualifying a general detector for the target domain in which the robot is deployed, showing also the trade-off between the effort for obtaining new examples from such a setting and the performance gain. In our extensive experimental campaign, we focus on the door detection task (namely recognizing the presence and the traversability of doorways) that, in dynamic settings, is useful to infer the topology of the map. Our findings are validated in a real-world robot deployment, comparing prominent deep-learning models and demonstrating the effectiveness of our approach in practical settings.
format Preprint
id arxiv_https___arxiv_org_abs_2401_17996
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection
Antonazzi, Michele
Luperto, Matteo
Borghese, N. Alberto
Basilico, Nicola
Robotics
Mobile service robots are increasingly prevalent in human-centric, real-world domains, operating autonomously in unconstrained indoor environments. In such a context, robotic vision plays a central role in enabling service robots to perceive high-level environmental features from visual observations. Despite the data-driven approaches based on deep learning push the boundaries of vision systems, applying these techniques to real-world robotic scenarios presents unique methodological challenges. Traditional models fail to represent the challenging perception constraints typical of service robots and must be adapted for the specific environment where robots finally operate. We propose a method leveraging photorealistic simulations that balances data quality and acquisition costs for synthesizing visual datasets from the robot perspective used to train deep architectures. Then, we show the benefits in qualifying a general detector for the target domain in which the robot is deployed, showing also the trade-off between the effort for obtaining new examples from such a setting and the performance gain. In our extensive experimental campaign, we focus on the door detection task (namely recognizing the presence and the traversability of doorways) that, in dynamic settings, is useful to infer the topology of the map. Our findings are validated in a real-world robot deployment, comparing prominent deep-learning models and demonstrating the effectiveness of our approach in practical settings.
title Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection
topic Robotics
url https://arxiv.org/abs/2401.17996