ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Peterson, Mason B., Jia, Yixuan, Tian, Yulun, Thomas, Annika, How, Jonathan P.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913811420676096
author Peterson, Mason B.
Jia, Yixuan
Tian, Yulun
Thomas, Annika
How, Jonathan P.
author_facet Peterson, Mason B.
Jia, Yixuan
Tian, Yulun
Thomas, Annika
How, Jonathan P.
contents Global localization is a fundamental capability required for long-term and drift-free robot navigation. However, current methods fail to relocalize when faced with significantly different viewpoints. We present ROMAN (Robust Object Map Alignment Anywhere), a global localization method capable of localizing in challenging and diverse environments by creating and aligning maps of open-set and view-invariant objects. ROMAN formulates and solves a registration problem between object submaps using a unified graph-theoretic global data association approach with a novel incorporation of a gravity direction prior and object shape and semantic similarity. This work's open-set object mapping and information-rich object association algorithm enables global localization, even in instances when maps are created from robots traveling in opposite directions. Through a set of challenging global localization experiments in indoor, urban, and unstructured/forested environments, we demonstrate that ROMAN achieves higher relative pose estimation accuracy than other image-based pose estimation methods or segment-based registration methods. Additionally, we evaluate ROMAN as a loop closure module in large-scale multi-robot SLAM and show a 35% improvement in trajectory estimation error compared to standard SLAM systems using visual features for loop closures. Code and videos can be found at https://acl.mit.edu/roman.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08262
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localization
Peterson, Mason B.
Jia, Yixuan
Tian, Yulun
Thomas, Annika
How, Jonathan P.
Robotics
Global localization is a fundamental capability required for long-term and drift-free robot navigation. However, current methods fail to relocalize when faced with significantly different viewpoints. We present ROMAN (Robust Object Map Alignment Anywhere), a global localization method capable of localizing in challenging and diverse environments by creating and aligning maps of open-set and view-invariant objects. ROMAN formulates and solves a registration problem between object submaps using a unified graph-theoretic global data association approach with a novel incorporation of a gravity direction prior and object shape and semantic similarity. This work's open-set object mapping and information-rich object association algorithm enables global localization, even in instances when maps are created from robots traveling in opposite directions. Through a set of challenging global localization experiments in indoor, urban, and unstructured/forested environments, we demonstrate that ROMAN achieves higher relative pose estimation accuracy than other image-based pose estimation methods or segment-based registration methods. Additionally, we evaluate ROMAN as a loop closure module in large-scale multi-robot SLAM and show a 35% improvement in trajectory estimation error compared to standard SLAM systems using visual features for loop closures. Code and videos can be found at https://acl.mit.edu/roman.
title ROMAN: Open-Set Object Map Alignment for Robust View-Invariant Global Localization
topic Robotics
url https://arxiv.org/abs/2410.08262