Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xu, Ruizhuo, Wang, Ke, Deng, Chao, Wang, Mei, Chen, Xi, Huang, Wenhui, Feng, Junlan, Deng, Weihong
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910285271400448
author Xu, Ruizhuo
Wang, Ke
Deng, Chao
Wang, Mei
Chen, Xi
Huang, Wenhui
Feng, Junlan
Deng, Weihong
author_facet Xu, Ruizhuo
Wang, Ke
Deng, Chao
Wang, Mei
Chen, Xi
Huang, Wenhui
Feng, Junlan
Deng, Weihong
contents With the increasing availability of consumer depth sensors, 3D face recognition (FR) has attracted more and more attention. However, the data acquired by these sensors are often coarse and noisy, making them impractical to use directly. In this paper, we introduce an innovative Depth map denoising network (DMDNet) based on the Denoising Implicit Image Function (DIIF) to reduce noise and enhance the quality of facial depth images for low-quality 3D FR. After generating clean depth faces using DMDNet, we further design a powerful recognition network called Lightweight Depth and Normal Fusion network (LDNFNet), which incorporates a multi-branch fusion block to learn unique and complementary features between different modalities such as depth and normal images. Comprehensive experiments conducted on four distinct low-quality databases demonstrate the effectiveness and robustness of our proposed methods. Furthermore, when combining DMDNet and LDNFNet, we achieve state-of-the-art results on the Lock3DFace database.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00719
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition
Xu, Ruizhuo
Wang, Ke
Deng, Chao
Wang, Mei
Chen, Xi
Huang, Wenhui
Feng, Junlan
Deng, Weihong
Computer Vision and Pattern Recognition
Artificial Intelligence
With the increasing availability of consumer depth sensors, 3D face recognition (FR) has attracted more and more attention. However, the data acquired by these sensors are often coarse and noisy, making them impractical to use directly. In this paper, we introduce an innovative Depth map denoising network (DMDNet) based on the Denoising Implicit Image Function (DIIF) to reduce noise and enhance the quality of facial depth images for low-quality 3D FR. After generating clean depth faces using DMDNet, we further design a powerful recognition network called Lightweight Depth and Normal Fusion network (LDNFNet), which incorporates a multi-branch fusion block to learn unique and complementary features between different modalities such as depth and normal images. Comprehensive experiments conducted on four distinct low-quality databases demonstrate the effectiveness and robustness of our proposed methods. Furthermore, when combining DMDNet and LDNFNet, we achieve state-of-the-art results on the Lock3DFace database.
title Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2401.00719