Saved in:
Bibliographic Details
Main Authors: Zhao, Dapeng, Qi, Yue
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2412.18920
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916543328157696
author Zhao, Dapeng
Qi, Yue
author_facet Zhao, Dapeng
Qi, Yue
contents Over the past few years, single-view 3D face reconstruction methods can produce beautiful 3D models. Nevertheless,the input of these works is unobstructed faces.We describe a system designed to reconstruct convincing face texture in the case of occlusion.Motivated by parsing facial features,we propose a complete face parsing map generation method guided by landmarks.We estimate the 2D face structure of the reasonable position of the occlusion area,which is used for the construction of 3D texture.An excellent anti-occlusion face reconstruction method should ensure the authenticity of the output,including the topological structure between the eyes,nose, and mouth. We extensively tested our method and its components, qualitatively demonstrating the rationality of our estimated facial structure. We conduct extensive experiments on general 3D face reconstruction tasks as concrete examples to demonstrate the method's superior regulation ability over existing methods often break down.We further provide numerous quantitative examples showing that our method advances both the quality and the robustness of 3D face reconstruction under occlusion scenes.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18920
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes
Zhao, Dapeng
Qi, Yue
Computer Vision and Pattern Recognition
Over the past few years, single-view 3D face reconstruction methods can produce beautiful 3D models. Nevertheless,the input of these works is unobstructed faces.We describe a system designed to reconstruct convincing face texture in the case of occlusion.Motivated by parsing facial features,we propose a complete face parsing map generation method guided by landmarks.We estimate the 2D face structure of the reasonable position of the occlusion area,which is used for the construction of 3D texture.An excellent anti-occlusion face reconstruction method should ensure the authenticity of the output,including the topological structure between the eyes,nose, and mouth. We extensively tested our method and its components, qualitatively demonstrating the rationality of our estimated facial structure. We conduct extensive experiments on general 3D face reconstruction tasks as concrete examples to demonstrate the method's superior regulation ability over existing methods often break down.We further provide numerous quantitative examples showing that our method advances both the quality and the robustness of 3D face reconstruction under occlusion scenes.
title Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.18920