Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929623242113024 |
|---|---|
| author | Meng, Jiarui Li, Haijie Wu, Yanmin Gao, Qiankun Yang, Shuzhou Zhang, Jian Ma, Siwei |
| author_facet | Meng, Jiarui Li, Haijie Wu, Yanmin Gao, Qiankun Yang, Shuzhou Zhang, Jian Ma, Siwei |
| contents | 3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors, leading to incorrect reconstructions and inconsistent reflective properties. To address this challenge, we introduce Mirror-3DGS, a novel framework designed to accurately handle mirror geometries and reflections, thereby generating realistic mirror reflections. By incorporating mirror attributes into 3DGS and leveraging plane mirror imaging principles, Mirror-3DGS simulates a mirrored viewpoint from behind the mirror, enhancing the realism of scene renderings. Extensive evaluations on both synthetic and real-world scenes demonstrate that our method can render novel views with improved fidelity in real-time, surpassing the state-of-the-art Mirror-NeRF, especially in mirror regions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_01168 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting Meng, Jiarui Li, Haijie Wu, Yanmin Gao, Qiankun Yang, Shuzhou Zhang, Jian Ma, Siwei Computer Vision and Pattern Recognition Graphics 3D Gaussian Splatting (3DGS) has significantly advanced 3D scene reconstruction and novel view synthesis. However, like Neural Radiance Fields (NeRF), 3DGS struggles with accurately modeling physical reflections, particularly in mirrors, leading to incorrect reconstructions and inconsistent reflective properties. To address this challenge, we introduce Mirror-3DGS, a novel framework designed to accurately handle mirror geometries and reflections, thereby generating realistic mirror reflections. By incorporating mirror attributes into 3DGS and leveraging plane mirror imaging principles, Mirror-3DGS simulates a mirrored viewpoint from behind the mirror, enhancing the realism of scene renderings. Extensive evaluations on both synthetic and real-world scenes demonstrate that our method can render novel views with improved fidelity in real-time, surpassing the state-of-the-art Mirror-NeRF, especially in mirror regions. |
| title | Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2404.01168 |