Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.02074 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917683736346624 |
|---|---|
| author | Li, Yinglong Wu, Hongyu Wang, Xiaogang Qin, Qingzhao Zhao, Yijiao wang, Yong Hao, Aimin |
| author_facet | Li, Yinglong Wu, Hongyu Wang, Xiaogang Qin, Qingzhao Zhao, Yijiao wang, Yong Hao, Aimin |
| contents | We propose FaceCom, a method for 3D facial shape completion, which delivers high-fidelity results for incomplete facial inputs of arbitrary forms. Unlike end-to-end shape completion methods based on point clouds or voxels, our approach relies on a mesh-based generative network that is easy to optimize, enabling it to handle shape completion for irregular facial scans. We first train a shape generator on a mixed 3D facial dataset containing 2405 identities. Based on the incomplete facial input, we fit complete faces using an optimization approach under image inpainting guidance. The completion results are refined through a post-processing step. FaceCom demonstrates the ability to effectively and naturally complete facial scan data with varying missing regions and degrees of missing areas. Our method can be used in medical prosthetic fabrication and the registration of deficient scanning data. Our experimental results demonstrate that FaceCom achieves exceptional performance in fitting and shape completion tasks. The code is available at https://github.com/dragonylee/FaceCom.git. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_02074 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance Li, Yinglong Wu, Hongyu Wang, Xiaogang Qin, Qingzhao Zhao, Yijiao wang, Yong Hao, Aimin Computer Vision and Pattern Recognition We propose FaceCom, a method for 3D facial shape completion, which delivers high-fidelity results for incomplete facial inputs of arbitrary forms. Unlike end-to-end shape completion methods based on point clouds or voxels, our approach relies on a mesh-based generative network that is easy to optimize, enabling it to handle shape completion for irregular facial scans. We first train a shape generator on a mixed 3D facial dataset containing 2405 identities. Based on the incomplete facial input, we fit complete faces using an optimization approach under image inpainting guidance. The completion results are refined through a post-processing step. FaceCom demonstrates the ability to effectively and naturally complete facial scan data with varying missing regions and degrees of missing areas. Our method can be used in medical prosthetic fabrication and the registration of deficient scanning data. Our experimental results demonstrate that FaceCom achieves exceptional performance in fitting and shape completion tasks. The code is available at https://github.com/dragonylee/FaceCom.git. |
| title | FaceCom: Towards High-fidelity 3D Facial Shape Completion via Optimization and Inpainting Guidance |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.02074 |