Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.06592 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929457518870528 |
|---|---|
| author | Tao, Jianyu Hu, Changping Yang, Edward Xu, Jing Chen, Rui |
| author_facet | Tao, Jianyu Hu, Changping Yang, Edward Xu, Jing Chen, Rui |
| contents | NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough information for accurate geometry reconstruction. In this work, we propose ActiveNeRF, a 3D geometry reconstruction framework, which improves the geometry quality of NeRF by actively projecting patterns of high spatial frequency onto the scene using a projector which has a constant relative pose to the camera. We design a learnable active pattern rendering pipeline which jointly learns the scene geometry and the active pattern. We find that, by adding the active pattern and imposing its consistency across different views, our proposed method outperforms state of the art geometry reconstruction methods qualitatively and quantitatively in both simulation and real experiments. Code is avaliable at https://github.com/hcp16/active_nerf |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_06592 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ActiveNeRF: Learning Accurate 3D Geometry by Active Pattern Projection Tao, Jianyu Hu, Changping Yang, Edward Xu, Jing Chen, Rui Computer Vision and Pattern Recognition NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough information for accurate geometry reconstruction. In this work, we propose ActiveNeRF, a 3D geometry reconstruction framework, which improves the geometry quality of NeRF by actively projecting patterns of high spatial frequency onto the scene using a projector which has a constant relative pose to the camera. We design a learnable active pattern rendering pipeline which jointly learns the scene geometry and the active pattern. We find that, by adding the active pattern and imposing its consistency across different views, our proposed method outperforms state of the art geometry reconstruction methods qualitatively and quantitatively in both simulation and real experiments. Code is avaliable at https://github.com/hcp16/active_nerf |
| title | ActiveNeRF: Learning Accurate 3D Geometry by Active Pattern Projection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2408.06592 |