Saved in:
Bibliographic Details
Main Authors: Geissbühler, David, Shahreza, Hatef Otroshi, Marcel, Sébastien
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.00228
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916782523023360
author Geissbühler, David
Shahreza, Hatef Otroshi
Marcel, Sébastien
author_facet Geissbühler, David
Shahreza, Hatef Otroshi
Marcel, Sébastien
contents Face recognition models are trained on large-scale datasets, which have privacy and ethical concerns. Lately, the use of synthetic data to complement or replace genuine data for the training of face recognition models has been proposed. While promising results have been obtained, it still remains unclear if generative models can yield diverse enough data for such tasks. In this work, we introduce a new method, inspired by the physical motion of soft particles subjected to stochastic Brownian forces, allowing us to sample identities distributions in a latent space under various constraints. We introduce three complementary algorithms, called Langevin, Dispersion, and DisCo, aimed at generating large synthetic face datasets. With this in hands, we generate several face datasets and benchmark them by training face recognition models, showing that data generated with our method exceeds the performance of previously GAN-based datasets and achieves competitive performance with state-of-the-art diffusion-based synthetic datasets. While diffusion models are shown to memorize training data, we prevent leakage in our new synthetic datasets, paving the way for more responsible synthetic datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2405_00228
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Synthetic Face Datasets Generation via Latent Space Exploration from Brownian Identity Diffusion
Geissbühler, David
Shahreza, Hatef Otroshi
Marcel, Sébastien
Computer Vision and Pattern Recognition
Face recognition models are trained on large-scale datasets, which have privacy and ethical concerns. Lately, the use of synthetic data to complement or replace genuine data for the training of face recognition models has been proposed. While promising results have been obtained, it still remains unclear if generative models can yield diverse enough data for such tasks. In this work, we introduce a new method, inspired by the physical motion of soft particles subjected to stochastic Brownian forces, allowing us to sample identities distributions in a latent space under various constraints. We introduce three complementary algorithms, called Langevin, Dispersion, and DisCo, aimed at generating large synthetic face datasets. With this in hands, we generate several face datasets and benchmark them by training face recognition models, showing that data generated with our method exceeds the performance of previously GAN-based datasets and achieves competitive performance with state-of-the-art diffusion-based synthetic datasets. While diffusion models are shown to memorize training data, we prevent leakage in our new synthetic datasets, paving the way for more responsible synthetic datasets.
title Synthetic Face Datasets Generation via Latent Space Exploration from Brownian Identity Diffusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.00228