A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Allu, Sai Haneesh, Kadosh, Itay, Summers, Tyler, Xiang, Yu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914047669043200
author Allu, Sai Haneesh
Kadosh, Itay
Summers, Tyler
Xiang, Yu
author_facet Allu, Sai Haneesh
Kadosh, Itay
Summers, Tyler
Xiang, Yu
contents We present a modular robotic system for autonomous exploration and semantic updating of large-scale unknown environments. Our approach enables a mobile robot to build, revisit, and update a hybrid semantic map that integrates a 2D occupancy grid for geometry with a topological graph for object semantics. Unlike prior methods that rely on manual teleoperation or precollected datasets, our two-phase approach achieves end-to-end autonomy: first, a modified frontier-based exploration algorithm with dynamic search windows constructs a geometric map; second, using a greedy trajectory planner, environments are revisited, and object semantics are updated using open-vocabulary object detection and segmentation. This modular system, compatible with any metric SLAM framework, supports continuous operation by efficiently updating the semantic graph to reflect short-term and long-term changes such as object relocation, removal, or addition. We validate the approach on a Fetch robot in real-world indoor environments of approximately $8,500$m$^2$ and $117$m$^2$, demonstrating robust and scalable semantic mapping and continuous adaptation, marking a fully autonomous integration of exploration, mapping, and semantic updating on a physical robot.
format Preprint
id arxiv_https___arxiv_org_abs_2409_15493
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments
Allu, Sai Haneesh
Kadosh, Itay
Summers, Tyler
Xiang, Yu
Robotics
Computer Vision and Pattern Recognition
We present a modular robotic system for autonomous exploration and semantic updating of large-scale unknown environments. Our approach enables a mobile robot to build, revisit, and update a hybrid semantic map that integrates a 2D occupancy grid for geometry with a topological graph for object semantics. Unlike prior methods that rely on manual teleoperation or precollected datasets, our two-phase approach achieves end-to-end autonomy: first, a modified frontier-based exploration algorithm with dynamic search windows constructs a geometric map; second, using a greedy trajectory planner, environments are revisited, and object semantics are updated using open-vocabulary object detection and segmentation. This modular system, compatible with any metric SLAM framework, supports continuous operation by efficiently updating the semantic graph to reflect short-term and long-term changes such as object relocation, removal, or addition. We validate the approach on a Fetch robot in real-world indoor environments of approximately $8,500$m$^2$ and $117$m$^2$, demonstrating robust and scalable semantic mapping and continuous adaptation, marking a fully autonomous integration of exploration, mapping, and semantic updating on a physical robot.
title A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.15493