SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910411601739776 |
|---|---|
| author | Keetha, Nikhil Karhade, Jay Jatavallabhula, Krishna Murthy Yang, Gengshan Scherer, Sebastian Ramanan, Deva Luiten, Jonathon |
| author_facet | Keetha, Nikhil Karhade, Jay Jatavallabhula, Krishna Murthy Yang, Gengshan Scherer, Sebastian Ramanan, Deva Luiten, Jonathon |
| contents | Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces SplaTAM, an approach that, for the first time, leverages explicit volumetric representations, i.e., 3D Gaussians, to enable high-fidelity reconstruction from a single unposed RGB-D camera, surpassing the capabilities of existing methods. SplaTAM employs a simple online tracking and mapping system tailored to the underlying Gaussian representation. It utilizes a silhouette mask to elegantly capture the presence of scene density. This combination enables several benefits over prior representations, including fast rendering and dense optimization, quickly determining if areas have been previously mapped, and structured map expansion by adding more Gaussians. Extensive experiments show that SplaTAM achieves up to 2x superior performance in camera pose estimation, map construction, and novel-view synthesis over existing methods, paving the way for more immersive high-fidelity SLAM applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_02126 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM Keetha, Nikhil Karhade, Jay Jatavallabhula, Krishna Murthy Yang, Gengshan Scherer, Sebastian Ramanan, Deva Luiten, Jonathon Computer Vision and Pattern Recognition Artificial Intelligence Robotics Dense simultaneous localization and mapping (SLAM) is crucial for robotics and augmented reality applications. However, current methods are often hampered by the non-volumetric or implicit way they represent a scene. This work introduces SplaTAM, an approach that, for the first time, leverages explicit volumetric representations, i.e., 3D Gaussians, to enable high-fidelity reconstruction from a single unposed RGB-D camera, surpassing the capabilities of existing methods. SplaTAM employs a simple online tracking and mapping system tailored to the underlying Gaussian representation. It utilizes a silhouette mask to elegantly capture the presence of scene density. This combination enables several benefits over prior representations, including fast rendering and dense optimization, quickly determining if areas have been previously mapped, and structured map expansion by adding more Gaussians. Extensive experiments show that SplaTAM achieves up to 2x superior performance in camera pose estimation, map construction, and novel-view synthesis over existing methods, paving the way for more immersive high-fidelity SLAM applications. |
| title | SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Robotics |
| url | https://arxiv.org/abs/2312.02126 |