Saved in:
Bibliographic Details
Main Authors: Rahimi, Parsa, Razeghi, Behrooz, Marcel, Sebastien
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.07627
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912154243825664
author Rahimi, Parsa
Razeghi, Behrooz
Marcel, Sebastien
author_facet Rahimi, Parsa
Razeghi, Behrooz
Marcel, Sebastien
contents In this paper, we investigate the potential of image-to-image translation (I2I) techniques for transferring realism to 3D-rendered facial images in the context of Face Recognition (FR) systems. The primary motivation for using 3D-rendered facial images lies in their ability to circumvent the challenges associated with collecting large real face datasets for training FR systems. These images are generated entirely by 3D rendering engines, facilitating the generation of synthetic identities. However, it has been observed that FR systems trained on such synthetic datasets underperform when compared to those trained on real datasets, on various FR benchmarks. In this work, we demonstrate that by transferring the realism to 3D-rendered images (i.e., making the 3D-rendered images look more real), we can boost the performance of FR systems trained on these more photorealistic images. This improvement is evident when these systems are evaluated against FR benchmarks utilizing real-world data, thereby paving new pathways for employing synthetic data in real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2407_07627
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognition
Rahimi, Parsa
Razeghi, Behrooz
Marcel, Sebastien
Computer Vision and Pattern Recognition
In this paper, we investigate the potential of image-to-image translation (I2I) techniques for transferring realism to 3D-rendered facial images in the context of Face Recognition (FR) systems. The primary motivation for using 3D-rendered facial images lies in their ability to circumvent the challenges associated with collecting large real face datasets for training FR systems. These images are generated entirely by 3D rendering engines, facilitating the generation of synthetic identities. However, it has been observed that FR systems trained on such synthetic datasets underperform when compared to those trained on real datasets, on various FR benchmarks. In this work, we demonstrate that by transferring the realism to 3D-rendered images (i.e., making the 3D-rendered images look more real), we can boost the performance of FR systems trained on these more photorealistic images. This improvement is evident when these systems are evaluated against FR benchmarks utilizing real-world data, thereby paving new pathways for employing synthetic data in real-world applications.
title Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.07627