WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914058535436288 |
|---|---|
| author | Liu, Yanbaihui Chen, Boyuan |
| author_facet | Liu, Yanbaihui Chen, Boyuan |
| contents | We propose WildFusion, a novel approach for 3D scene reconstruction in unstructured, in-the-wild environments using multimodal implicit neural representations. WildFusion integrates signals from LiDAR, RGB camera, contact microphones, tactile sensors, and IMU. This multimodal fusion generates comprehensive, continuous environmental representations, including pixel-level geometry, color, semantics, and traversability. Through real-world experiments on legged robot navigation in challenging forest environments, WildFusion demonstrates improved route selection by accurately predicting traversability. Our results highlight its potential to advance robotic navigation and 3D mapping in complex outdoor terrains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_19904 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | WildFusion: Multimodal Implicit 3D Reconstructions in the Wild Liu, Yanbaihui Chen, Boyuan Robotics Multimedia Signal Processing We propose WildFusion, a novel approach for 3D scene reconstruction in unstructured, in-the-wild environments using multimodal implicit neural representations. WildFusion integrates signals from LiDAR, RGB camera, contact microphones, tactile sensors, and IMU. This multimodal fusion generates comprehensive, continuous environmental representations, including pixel-level geometry, color, semantics, and traversability. Through real-world experiments on legged robot navigation in challenging forest environments, WildFusion demonstrates improved route selection by accurately predicting traversability. Our results highlight its potential to advance robotic navigation and 3D mapping in complex outdoor terrains. |
| title | WildFusion: Multimodal Implicit 3D Reconstructions in the Wild |
| topic | Robotics Multimedia Signal Processing |
| url | https://arxiv.org/abs/2409.19904 |