Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2312.13102 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911877594873856 |
|---|---|
| author | Ma, Li Agrawal, Vasu Turki, Haithem Kim, Changil Gao, Chen Sander, Pedro Zollhöfer, Michael Richardt, Christian |
| author_facet | Ma, Li Agrawal, Vasu Turki, Haithem Kim, Changil Gao, Chen Sander, Pedro Zollhöfer, Michael Richardt, Christian |
| contents | Neural radiance fields have achieved remarkable performance in modeling the appearance of 3D scenes. However, existing approaches still struggle with the view-dependent appearance of glossy surfaces, especially under complex lighting of indoor environments. Unlike existing methods, which typically assume distant lighting like an environment map, we propose a learnable Gaussian directional encoding to better model the view-dependent effects under near-field lighting conditions. Importantly, our new directional encoding captures the spatially-varying nature of near-field lighting and emulates the behavior of prefiltered environment maps. As a result, it enables the efficient evaluation of preconvolved specular color at any 3D location with varying roughness coefficients. We further introduce a data-driven geometry prior that helps alleviate the shape radiance ambiguity in reflection modeling. We show that our Gaussian directional encoding and geometry prior significantly improve the modeling of challenging specular reflections in neural radiance fields, which helps decompose appearance into more physically meaningful components. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_13102 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | SpecNeRF: Gaussian Directional Encoding for Specular Reflections Ma, Li Agrawal, Vasu Turki, Haithem Kim, Changil Gao, Chen Sander, Pedro Zollhöfer, Michael Richardt, Christian Computer Vision and Pattern Recognition Neural radiance fields have achieved remarkable performance in modeling the appearance of 3D scenes. However, existing approaches still struggle with the view-dependent appearance of glossy surfaces, especially under complex lighting of indoor environments. Unlike existing methods, which typically assume distant lighting like an environment map, we propose a learnable Gaussian directional encoding to better model the view-dependent effects under near-field lighting conditions. Importantly, our new directional encoding captures the spatially-varying nature of near-field lighting and emulates the behavior of prefiltered environment maps. As a result, it enables the efficient evaluation of preconvolved specular color at any 3D location with varying roughness coefficients. We further introduce a data-driven geometry prior that helps alleviate the shape radiance ambiguity in reflection modeling. We show that our Gaussian directional encoding and geometry prior significantly improve the modeling of challenging specular reflections in neural radiance fields, which helps decompose appearance into more physically meaningful components. |
| title | SpecNeRF: Gaussian Directional Encoding for Specular Reflections |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2312.13102 |