Saved in:
Bibliographic Details
Main Authors: Abati, Gabriel Fischer, Soares, João Carlos Virgolino, Medeiros, Vivian Suzano, Meggiolaro, Marco Antonio, Semini, Claudio
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.02177
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911865242648576
author Abati, Gabriel Fischer
Soares, João Carlos Virgolino
Medeiros, Vivian Suzano
Meggiolaro, Marco Antonio
Semini, Claudio
author_facet Abati, Gabriel Fischer
Soares, João Carlos Virgolino
Medeiros, Vivian Suzano
Meggiolaro, Marco Antonio
Semini, Claudio
contents The majority of visual SLAM systems are not robust in dynamic scenarios. The ones that deal with dynamic objects in the scenes usually rely on deep-learning-based methods to detect and filter these objects. However, these methods cannot deal with unknown moving objects. This work presents Panoptic-SLAM, an open-source visual SLAM system robust to dynamic environments, even in the presence of unknown objects. It uses panoptic segmentation to filter dynamic objects from the scene during the state estimation process. Panoptic-SLAM is based on ORB-SLAM3, a state-of-the-art SLAM system for static environments. The implementation was tested using real-world datasets and compared with several state-of-the-art systems from the literature, including DynaSLAM, DS-SLAM, SaD-SLAM, PVO and FusingPanoptic. For example, Panoptic-SLAM is on average four times more accurate than PVO, the most recent panoptic-based approach for visual SLAM. Also, experiments were performed using a quadruped robot with an RGB-D camera to test the applicability of our method in real-world scenarios. The tests were validated by a ground-truth created with a motion capture system.
format Preprint
id arxiv_https___arxiv_org_abs_2405_02177
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Panoptic-SLAM: Visual SLAM in Dynamic Environments using Panoptic Segmentation
Abati, Gabriel Fischer
Soares, João Carlos Virgolino
Medeiros, Vivian Suzano
Meggiolaro, Marco Antonio
Semini, Claudio
Robotics
The majority of visual SLAM systems are not robust in dynamic scenarios. The ones that deal with dynamic objects in the scenes usually rely on deep-learning-based methods to detect and filter these objects. However, these methods cannot deal with unknown moving objects. This work presents Panoptic-SLAM, an open-source visual SLAM system robust to dynamic environments, even in the presence of unknown objects. It uses panoptic segmentation to filter dynamic objects from the scene during the state estimation process. Panoptic-SLAM is based on ORB-SLAM3, a state-of-the-art SLAM system for static environments. The implementation was tested using real-world datasets and compared with several state-of-the-art systems from the literature, including DynaSLAM, DS-SLAM, SaD-SLAM, PVO and FusingPanoptic. For example, Panoptic-SLAM is on average four times more accurate than PVO, the most recent panoptic-based approach for visual SLAM. Also, experiments were performed using a quadruped robot with an RGB-D camera to test the applicability of our method in real-world scenarios. The tests were validated by a ground-truth created with a motion capture system.
title Panoptic-SLAM: Visual SLAM in Dynamic Environments using Panoptic Segmentation
topic Robotics
url https://arxiv.org/abs/2405.02177