SlerpFace: Face Template Protection via Spherical Linear Interpolation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhong, Zhizhou, Mi, Yuxi, Huang, Yuge, Xu, Jianqing, Mu, Guodong, Ding, Shouhong, Zhang, Jingyun, Guo, Rizen, Wu, Yunsheng, Zhou, Shuigeng
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909445118754816
author Zhong, Zhizhou
Mi, Yuxi
Huang, Yuge
Xu, Jianqing
Mu, Guodong
Ding, Shouhong
Zhang, Jingyun
Guo, Rizen
Wu, Yunsheng
Zhou, Shuigeng
author_facet Zhong, Zhizhou
Mi, Yuxi
Huang, Yuge
Xu, Jianqing
Mu, Guodong
Ding, Shouhong
Zhang, Jingyun
Guo, Rizen
Wu, Yunsheng
Zhou, Shuigeng
contents Contemporary face recognition systems use feature templates extracted from face images to identify persons. To enhance privacy, face template protection techniques are widely employed to conceal sensitive identity and appearance information stored in the template. This paper identifies an emerging privacy attack form utilizing diffusion models that could nullify prior protection. The attack can synthesize high-quality, identity-preserving face images from templates, revealing persons' appearance. Based on studies of the diffusion model's generative capability, this paper proposes a defense by rotating templates to a noise-like distribution. This is achieved efficiently by spherically and linearly interpolating templates on their located hypersphere. This paper further proposes to group-wisely divide and drop out templates' feature dimensions, to enhance the irreversibility of rotated templates. The proposed techniques are concretized as a novel face template protection technique, SlerpFace. Extensive experiments show that SlerpFace provides satisfactory recognition accuracy and comprehensive protection against inversion and other attack forms, superior to prior arts.
format Preprint
id arxiv_https___arxiv_org_abs_2407_03043
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SlerpFace: Face Template Protection via Spherical Linear Interpolation
Zhong, Zhizhou
Mi, Yuxi
Huang, Yuge
Xu, Jianqing
Mu, Guodong
Ding, Shouhong
Zhang, Jingyun
Guo, Rizen
Wu, Yunsheng
Zhou, Shuigeng
Computer Vision and Pattern Recognition
Contemporary face recognition systems use feature templates extracted from face images to identify persons. To enhance privacy, face template protection techniques are widely employed to conceal sensitive identity and appearance information stored in the template. This paper identifies an emerging privacy attack form utilizing diffusion models that could nullify prior protection. The attack can synthesize high-quality, identity-preserving face images from templates, revealing persons' appearance. Based on studies of the diffusion model's generative capability, this paper proposes a defense by rotating templates to a noise-like distribution. This is achieved efficiently by spherically and linearly interpolating templates on their located hypersphere. This paper further proposes to group-wisely divide and drop out templates' feature dimensions, to enhance the irreversibility of rotated templates. The proposed techniques are concretized as a novel face template protection technique, SlerpFace. Extensive experiments show that SlerpFace provides satisfactory recognition accuracy and comprehensive protection against inversion and other attack forms, superior to prior arts.
title SlerpFace: Face Template Protection via Spherical Linear Interpolation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.03043