NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914678612951040 |
|---|---|
| author | Fischer, Michael Li, Zhengqin Nguyen-Phuoc, Thu Bozic, Aljaz Dong, Zhao Marshall, Carl Ritschel, Tobias |
| author_facet | Fischer, Michael Li, Zhengqin Nguyen-Phuoc, Thu Bozic, Aljaz Dong, Zhao Marshall, Carl Ritschel, Tobias |
| contents | A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful way, such that the resulting new NeRF retains the target geometry but has an appearance that is an analogy to the source NeRF. To this end, we generalize classic image analogies from 2D images to NeRFs. We leverage correspondence transfer along semantic affinity that is driven by semantic features from large, pre-trained 2D image models to achieve multi-view consistent appearance transfer. Our method allows exploring the mix-and-match product space of 3D geometry and appearance. We show that our method outperforms traditional stylization-based methods and that a large majority of users prefer our method over several typical baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_08622 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs Fischer, Michael Li, Zhengqin Nguyen-Phuoc, Thu Bozic, Aljaz Dong, Zhao Marshall, Carl Ritschel, Tobias Computer Vision and Pattern Recognition Graphics A Neural Radiance Field (NeRF) encodes the specific relation of 3D geometry and appearance of a scene. We here ask the question whether we can transfer the appearance from a source NeRF onto a target 3D geometry in a semantically meaningful way, such that the resulting new NeRF retains the target geometry but has an appearance that is an analogy to the source NeRF. To this end, we generalize classic image analogies from 2D images to NeRFs. We leverage correspondence transfer along semantic affinity that is driven by semantic features from large, pre-trained 2D image models to achieve multi-view consistent appearance transfer. Our method allows exploring the mix-and-match product space of 3D geometry and appearance. We show that our method outperforms traditional stylization-based methods and that a large majority of users prefer our method over several typical baselines. |
| title | NeRF Analogies: Example-Based Visual Attribute Transfer for NeRFs |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2402.08622 |