Reconstructing Topology-Consistent Face Mesh by Volume Rendering from Multi-View Images
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912627561594880 |
|---|---|
| author | Wang, Yating Yi, Ran Lei, Xiaoning Fan, Ke Hao, Jinkun Ma, Lizhuang |
| author_facet | Wang, Yating Yi, Ran Lei, Xiaoning Fan, Ke Hao, Jinkun Ma, Lizhuang |
| contents | Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture settings. Recently NeRF has shown great advantages in 3D reconstruction, by representing scenes as density and radiance fields and utilizing neural volume rendering for novel view synthesis. Inspired by this, we introduce a novel method which combines explicit mesh with neural volume rendering to optimize geometry of an artist-made template face mesh from multi-view images while keeping the topology unchanged. Our method derives density fields from meshes using distance fields as an intermediary and encodes radiance field in compact tri-planes. To improve convergence, several adaptions tailored for meshes are introduced to the volume rendering. Experiments demonstrate that our method achieves superior reconstruction quality compared to previous approaches, validating the feasibility of integrating mesh and neural volume rendering. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_05606 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Reconstructing Topology-Consistent Face Mesh by Volume Rendering from Multi-View Images Wang, Yating Yi, Ran Lei, Xiaoning Fan, Ke Hao, Jinkun Ma, Lizhuang Computer Vision and Pattern Recognition Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture settings. Recently NeRF has shown great advantages in 3D reconstruction, by representing scenes as density and radiance fields and utilizing neural volume rendering for novel view synthesis. Inspired by this, we introduce a novel method which combines explicit mesh with neural volume rendering to optimize geometry of an artist-made template face mesh from multi-view images while keeping the topology unchanged. Our method derives density fields from meshes using distance fields as an intermediary and encodes radiance field in compact tri-planes. To improve convergence, several adaptions tailored for meshes are introduced to the volume rendering. Experiments demonstrate that our method achieves superior reconstruction quality compared to previous approaches, validating the feasibility of integrating mesh and neural volume rendering. |
| title | Reconstructing Topology-Consistent Face Mesh by Volume Rendering from Multi-View Images |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.05606 |