Wild2Avatar: Rendering Humans Behind Occlusions
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916900257136640 |
|---|---|
| author | Xiang, Tiange Sun, Adam Delp, Scott Kozuka, Kazuki Fei-Fei, Li Adeli, Ehsan |
| author_facet | Xiang, Tiange Sun, Adam Delp, Scott Kozuka, Kazuki Fei-Fei, Li Adeli, Ehsan |
| contents | Rendering the visual appearance of moving humans from occluded monocular videos is a challenging task. Most existing research renders 3D humans under ideal conditions, requiring a clear and unobstructed scene. Those methods cannot be used to render humans in real-world scenes where obstacles may block the camera's view and lead to partial occlusions. In this work, we present Wild2Avatar, a neural rendering approach catered for occluded in-the-wild monocular videos. We propose occlusion-aware scene parameterization for decoupling the scene into three parts - occlusion, human, and background. Additionally, extensive objective functions are designed to help enforce the decoupling of the human from both the occlusion and the background and to ensure the completeness of the human model. We verify the effectiveness of our approach with experiments on in-the-wild videos. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_00431 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Wild2Avatar: Rendering Humans Behind Occlusions Xiang, Tiange Sun, Adam Delp, Scott Kozuka, Kazuki Fei-Fei, Li Adeli, Ehsan Computer Vision and Pattern Recognition Rendering the visual appearance of moving humans from occluded monocular videos is a challenging task. Most existing research renders 3D humans under ideal conditions, requiring a clear and unobstructed scene. Those methods cannot be used to render humans in real-world scenes where obstacles may block the camera's view and lead to partial occlusions. In this work, we present Wild2Avatar, a neural rendering approach catered for occluded in-the-wild monocular videos. We propose occlusion-aware scene parameterization for decoupling the scene into three parts - occlusion, human, and background. Additionally, extensive objective functions are designed to help enforce the decoupling of the human from both the occlusion and the background and to ensure the completeness of the human model. We verify the effectiveness of our approach with experiments on in-the-wild videos. |
| title | Wild2Avatar: Rendering Humans Behind Occlusions |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.00431 |