Human Interaction for Collaborative Semantic SLAM using Extended Reality
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914045785800704 |
|---|---|
| author | Ribeiro, Laura Shaheer, Muhammad Fernandez-Cortizas, Miguel Tourani, Ali Voos, Holger Sanchez-Lopez, Jose Luis |
| author_facet | Ribeiro, Laura Shaheer, Muhammad Fernandez-Cortizas, Miguel Tourani, Ali Voos, Holger Sanchez-Lopez, Jose Luis |
| contents | Semantic SLAM (Simultaneous Localization and Mapping) systems enrich robot maps with structural and semantic information, enabling robots to operate more effectively in complex environments. However, these systems struggle in real-world scenarios with occlusions, incomplete data, or ambiguous geometries, as they cannot fully leverage the higher-level spatial and semantic knowledge humans naturally apply. We introduce HICS-SLAM, a Human-in-the-Loop semantic SLAM framework that uses a shared extended reality environment for real-time collaboration. The system allows human operators to directly interact with and visualize the robot's 3D scene graph, and add high-level semantic concepts (e.g., rooms or structural entities) into the mapping process. We propose a graph-based semantic fusion methodology that integrates these human interventions with robot perception, enabling scalable collaboration for enhanced situational awareness. Experimental evaluations on real-world construction site datasets demonstrate improvements in room detection accuracy, map precision, and semantic completeness compared to automated baselines, demonstrating both the effectiveness of the approach and its potential for future extensions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_14949 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Human Interaction for Collaborative Semantic SLAM using Extended Reality Ribeiro, Laura Shaheer, Muhammad Fernandez-Cortizas, Miguel Tourani, Ali Voos, Holger Sanchez-Lopez, Jose Luis Robotics Human-Computer Interaction Semantic SLAM (Simultaneous Localization and Mapping) systems enrich robot maps with structural and semantic information, enabling robots to operate more effectively in complex environments. However, these systems struggle in real-world scenarios with occlusions, incomplete data, or ambiguous geometries, as they cannot fully leverage the higher-level spatial and semantic knowledge humans naturally apply. We introduce HICS-SLAM, a Human-in-the-Loop semantic SLAM framework that uses a shared extended reality environment for real-time collaboration. The system allows human operators to directly interact with and visualize the robot's 3D scene graph, and add high-level semantic concepts (e.g., rooms or structural entities) into the mapping process. We propose a graph-based semantic fusion methodology that integrates these human interventions with robot perception, enabling scalable collaboration for enhanced situational awareness. Experimental evaluations on real-world construction site datasets demonstrate improvements in room detection accuracy, map precision, and semantic completeness compared to automated baselines, demonstrating both the effectiveness of the approach and its potential for future extensions. |
| title | Human Interaction for Collaborative Semantic SLAM using Extended Reality |
| topic | Robotics Human-Computer Interaction |
| url | https://arxiv.org/abs/2509.14949 |