Topo-Field: Topometric mapping with Brain-inspired Hierarchical Layout-Object-Position Fields

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hou, Jiawei, Guan, Wenhao, Liang, Longfei, Feng, Jianfeng, Xue, Xiangyang, Zeng, Taiping
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917879236001792
author Hou, Jiawei
Guan, Wenhao
Liang, Longfei
Feng, Jianfeng
Xue, Xiangyang
Zeng, Taiping
author_facet Hou, Jiawei
Guan, Wenhao
Liang, Longfei
Feng, Jianfeng
Xue, Xiangyang
Zeng, Taiping
contents Mobile robots require comprehensive scene understanding to operate effectively in diverse environments, enriched with contextual information such as layouts, objects, and their relationships. Although advances like neural radiation fields (NeRFs) offer high-fidelity 3D reconstructions, they are computationally intensive and often lack efficient representations of traversable spaces essential for planning and navigation. In contrast, topological maps are computationally efficient but lack the semantic richness necessary for a more complete understanding of the environment. Inspired by a population code in the postrhinal cortex (POR) strongly tuned to spatial layouts over scene content rapidly forming a high-level cognitive map, this work introduces Topo-Field, a framework that integrates Layout-Object-Position (LOP) associations into a neural field and constructs a topometric map from this learned representation. LOP associations are modeled by explicitly encoding object and layout information, while a Large Foundation Model (LFM) technique allows for efficient training without extensive annotations. The topometric map is then constructed by querying the learned neural representation, offering both semantic richness and computational efficiency. Empirical evaluations in multi-room environments demonstrate the effectiveness of Topo-Field in tasks such as position attribute inference, query localization, and topometric planning, successfully bridging the gap between high-fidelity scene understanding and efficient robotic navigation.
format Preprint
id arxiv_https___arxiv_org_abs_2406_05985
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Topo-Field: Topometric mapping with Brain-inspired Hierarchical Layout-Object-Position Fields
Hou, Jiawei
Guan, Wenhao
Liang, Longfei
Feng, Jianfeng
Xue, Xiangyang
Zeng, Taiping
Robotics
Mobile robots require comprehensive scene understanding to operate effectively in diverse environments, enriched with contextual information such as layouts, objects, and their relationships. Although advances like neural radiation fields (NeRFs) offer high-fidelity 3D reconstructions, they are computationally intensive and often lack efficient representations of traversable spaces essential for planning and navigation. In contrast, topological maps are computationally efficient but lack the semantic richness necessary for a more complete understanding of the environment. Inspired by a population code in the postrhinal cortex (POR) strongly tuned to spatial layouts over scene content rapidly forming a high-level cognitive map, this work introduces Topo-Field, a framework that integrates Layout-Object-Position (LOP) associations into a neural field and constructs a topometric map from this learned representation. LOP associations are modeled by explicitly encoding object and layout information, while a Large Foundation Model (LFM) technique allows for efficient training without extensive annotations. The topometric map is then constructed by querying the learned neural representation, offering both semantic richness and computational efficiency. Empirical evaluations in multi-room environments demonstrate the effectiveness of Topo-Field in tasks such as position attribute inference, query localization, and topometric planning, successfully bridging the gap between high-fidelity scene understanding and efficient robotic navigation.
title Topo-Field: Topometric mapping with Brain-inspired Hierarchical Layout-Object-Position Fields
topic Robotics
url https://arxiv.org/abs/2406.05985