VLPG-Nav: Object Navigation Using Visual Language Pose Graph and Object Localization Probability Maps
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909288088207360 |
|---|---|
| author | Arul, Senthil Hariharan Kumar, Dhruva Sugirtharaj, Vivek Kim, Richard Xuewei Qi Madhivanan, Rajasimman Sen, Arnie Manocha, Dinesh |
| author_facet | Arul, Senthil Hariharan Kumar, Dhruva Sugirtharaj, Vivek Kim, Richard Xuewei Qi Madhivanan, Rajasimman Sen, Arnie Manocha, Dinesh |
| contents | We present VLPG-Nav, a visual language navigation method for guiding robots to specified objects within household scenes. Unlike existing methods primarily focused on navigating the robot toward objects, our approach considers the additional challenge of centering the object within the robot's camera view. Our method builds a visual language pose graph (VLPG) that functions as a spatial map of VL embeddings. Given an open vocabulary object query, we plan a viewpoint for object navigation using the VLPG. Despite navigating to the viewpoint, real-world challenges like object occlusion, displacement, and the robot's localization error can prevent visibility. We build an object localization probability map that leverages the robot's current observations and prior VLPG. When the object isn't visible, the probability map is updated and an alternate viewpoint is computed. In addition, we propose an object-centering formulation that locally adjusts the robot's pose to center the object in the camera view. We evaluate the effectiveness of our approach through simulations and real-world experiments, evaluating its ability to successfully view and center the object within the camera field of view. VLPG-Nav demonstrates improved performance in locating the object, navigating around occlusions, and centering the object within the robot's camera view, outperforming the selected baselines in the evaluation metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_08301 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | VLPG-Nav: Object Navigation Using Visual Language Pose Graph and Object Localization Probability Maps Arul, Senthil Hariharan Kumar, Dhruva Sugirtharaj, Vivek Kim, Richard Xuewei Qi Madhivanan, Rajasimman Sen, Arnie Manocha, Dinesh Robotics We present VLPG-Nav, a visual language navigation method for guiding robots to specified objects within household scenes. Unlike existing methods primarily focused on navigating the robot toward objects, our approach considers the additional challenge of centering the object within the robot's camera view. Our method builds a visual language pose graph (VLPG) that functions as a spatial map of VL embeddings. Given an open vocabulary object query, we plan a viewpoint for object navigation using the VLPG. Despite navigating to the viewpoint, real-world challenges like object occlusion, displacement, and the robot's localization error can prevent visibility. We build an object localization probability map that leverages the robot's current observations and prior VLPG. When the object isn't visible, the probability map is updated and an alternate viewpoint is computed. In addition, we propose an object-centering formulation that locally adjusts the robot's pose to center the object in the camera view. We evaluate the effectiveness of our approach through simulations and real-world experiments, evaluating its ability to successfully view and center the object within the camera field of view. VLPG-Nav demonstrates improved performance in locating the object, navigating around occlusions, and centering the object within the robot's camera view, outperforming the selected baselines in the evaluation metrics. |
| title | VLPG-Nav: Object Navigation Using Visual Language Pose Graph and Object Localization Probability Maps |
| topic | Robotics |
| url | https://arxiv.org/abs/2408.08301 |