Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909577098821632 |
|---|---|
| author | Zhang, Shangzan Peng, Sida ShenTu, Yinji Shuai, Qing Chen, Tianrun Yu, Kaicheng Bao, Hujun Zhou, Xiaowei |
| author_facet | Zhang, Shangzan Peng, Sida ShenTu, Yinji Shuai, Qing Chen, Tianrun Yu, Kaicheng Bao, Hujun Zhou, Xiaowei |
| contents | Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we propose a novel framework to edit the local appearance of dynamic NeRFs by manipulating pixels in a single frame of training video. Specifically, to locally edit the appearance of dynamic NeRFs while preserving unedited regions, we introduce a local surface representation of the edited region, which can be inserted into and rendered along with the original NeRF and warped to arbitrary other frames through a learned invertible motion representation network. By employing our method, users without professional expertise can easily add desired content to the appearance of a dynamic scene. We extensively evaluate our approach on various scenes and show that our approach achieves spatially and temporally consistent editing results. Notably, our approach is versatile and applicable to different variants of dynamic NeRF representations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_12909 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields Zhang, Shangzan Peng, Sida ShenTu, Yinji Shuai, Qing Chen, Tianrun Yu, Kaicheng Bao, Hujun Zhou, Xiaowei Computer Vision and Pattern Recognition Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we propose a novel framework to edit the local appearance of dynamic NeRFs by manipulating pixels in a single frame of training video. Specifically, to locally edit the appearance of dynamic NeRFs while preserving unedited regions, we introduce a local surface representation of the edited region, which can be inserted into and rendered along with the original NeRF and warped to arbitrary other frames through a learned invertible motion representation network. By employing our method, users without professional expertise can easily add desired content to the appearance of a dynamic scene. We extensively evaluate our approach on various scenes and show that our approach achieves spatially and temporally consistent editing results. Notably, our approach is versatile and applicable to different variants of dynamic NeRF representations. |
| title | Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2307.12909 |