Personalized Privacy Protection Mask Against Unauthorized Facial Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chow, Ka-Ho, Hu, Sihao, Huang, Tiansheng, Liu, Ling
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911961841664000
author Chow, Ka-Ho
Hu, Sihao
Huang, Tiansheng
Liu, Ling
author_facet Chow, Ka-Ho
Hu, Sihao
Huang, Tiansheng
Liu, Ling
contents Face recognition (FR) can be abused for privacy intrusion. Governments, private companies, or even individual attackers can collect facial images by web scraping to build an FR system identifying human faces without their consent. This paper introduces Chameleon, which learns to generate a user-centric personalized privacy protection mask, coined as P3-Mask, to protect facial images against unauthorized FR with three salient features. First, we use a cross-image optimization to generate one P3-Mask for each user instead of tailoring facial perturbation for each facial image of a user. It enables efficient and instant protection even for users with limited computing resources. Second, we incorporate a perceptibility optimization to preserve the visual quality of the protected facial images. Third, we strengthen the robustness of P3-Mask against unknown FR models by integrating focal diversity-optimized ensemble learning into the mask generation process. Extensive experiments on two benchmark datasets show that Chameleon outperforms three state-of-the-art methods with instant protection and minimal degradation of image quality. Furthermore, Chameleon enables cost-effective FR authorization using the P3-Mask as a personalized de-obfuscation key, and it demonstrates high resilience against adaptive adversaries.
format Preprint
id arxiv_https___arxiv_org_abs_2407_13975
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Personalized Privacy Protection Mask Against Unauthorized Facial Recognition
Chow, Ka-Ho
Hu, Sihao
Huang, Tiansheng
Liu, Ling
Computer Vision and Pattern Recognition
Face recognition (FR) can be abused for privacy intrusion. Governments, private companies, or even individual attackers can collect facial images by web scraping to build an FR system identifying human faces without their consent. This paper introduces Chameleon, which learns to generate a user-centric personalized privacy protection mask, coined as P3-Mask, to protect facial images against unauthorized FR with three salient features. First, we use a cross-image optimization to generate one P3-Mask for each user instead of tailoring facial perturbation for each facial image of a user. It enables efficient and instant protection even for users with limited computing resources. Second, we incorporate a perceptibility optimization to preserve the visual quality of the protected facial images. Third, we strengthen the robustness of P3-Mask against unknown FR models by integrating focal diversity-optimized ensemble learning into the mask generation process. Extensive experiments on two benchmark datasets show that Chameleon outperforms three state-of-the-art methods with instant protection and minimal degradation of image quality. Furthermore, Chameleon enables cost-effective FR authorization using the P3-Mask as a personalized de-obfuscation key, and it demonstrates high resilience against adaptive adversaries.
title Personalized Privacy Protection Mask Against Unauthorized Facial Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.13975