IGFuse: Interactive 3D Gaussian Scene Reconstruction via Multi-Scans Fusion
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915449901416448 |
|---|---|
| author | Hu, Wenhao Li, Zesheng Zhou, Haonan Liu, Liu Wen, Xuexiang Su, Zhizhong Li, Xi Wang, Gaoang |
| author_facet | Hu, Wenhao Li, Zesheng Zhou, Haonan Liu, Liu Wen, Xuexiang Su, Zhizhong Li, Xi Wang, Gaoang |
| contents | Reconstructing complete and interactive 3D scenes remains a fundamental challenge in computer vision and robotics, particularly due to persistent object occlusions and limited sensor coverage. Multiview observations from a single scene scan often fail to capture the full structural details. Existing approaches typically rely on multi stage pipelines, such as segmentation, background completion, and inpainting or require per-object dense scanning, both of which are error-prone, and not easily scalable. We propose IGFuse, a novel framework that reconstructs interactive Gaussian scene by fusing observations from multiple scans, where natural object rearrangement between captures reveal previously occluded regions. Our method constructs segmentation aware Gaussian fields and enforces bi-directional photometric and semantic consistency across scans. To handle spatial misalignments, we introduce a pseudo-intermediate scene state for unified alignment, alongside collaborative co-pruning strategies to refine geometry. IGFuse enables high fidelity rendering and object level scene manipulation without dense observations or complex pipelines. Extensive experiments validate the framework's strong generalization to novel scene configurations, demonstrating its effectiveness for real world 3D reconstruction and real-to-simulation transfer. Our project page is available online. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_13153 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | IGFuse: Interactive 3D Gaussian Scene Reconstruction via Multi-Scans Fusion Hu, Wenhao Li, Zesheng Zhou, Haonan Liu, Liu Wen, Xuexiang Su, Zhizhong Li, Xi Wang, Gaoang Computer Vision and Pattern Recognition Reconstructing complete and interactive 3D scenes remains a fundamental challenge in computer vision and robotics, particularly due to persistent object occlusions and limited sensor coverage. Multiview observations from a single scene scan often fail to capture the full structural details. Existing approaches typically rely on multi stage pipelines, such as segmentation, background completion, and inpainting or require per-object dense scanning, both of which are error-prone, and not easily scalable. We propose IGFuse, a novel framework that reconstructs interactive Gaussian scene by fusing observations from multiple scans, where natural object rearrangement between captures reveal previously occluded regions. Our method constructs segmentation aware Gaussian fields and enforces bi-directional photometric and semantic consistency across scans. To handle spatial misalignments, we introduce a pseudo-intermediate scene state for unified alignment, alongside collaborative co-pruning strategies to refine geometry. IGFuse enables high fidelity rendering and object level scene manipulation without dense observations or complex pipelines. Extensive experiments validate the framework's strong generalization to novel scene configurations, demonstrating its effectiveness for real world 3D reconstruction and real-to-simulation transfer. Our project page is available online. |
| title | IGFuse: Interactive 3D Gaussian Scene Reconstruction via Multi-Scans Fusion |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.13153 |