My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yam, Hon Ming, Guo, Zhongliang, Lau, Chun Pong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916749209763840
author Yam, Hon Ming
Guo, Zhongliang
Lau, Chun Pong
author_facet Yam, Hon Ming
Guo, Zhongliang
Lau, Chun Pong
contents The proliferation of diffusion-based deepfake technologies poses significant risks for unauthorized and unethical facial image manipulation. While traditional countermeasures have primarily focused on passive detection methods, this paper introduces a novel proactive defense strategy through adversarial attacks that preemptively protect facial images from being exploited by diffusion-based deepfake systems. Existing adversarial protection methods predominantly target conventional generative architectures (GANs, AEs, VAEs) and fail to address the unique challenges presented by diffusion models, which have become the predominant framework for high-quality facial deepfakes. Current diffusion-specific adversarial approaches are limited by their reliance on specific model architectures and weights, rendering them ineffective against the diverse landscape of diffusion-based deepfake implementations. Additionally, they typically employ global perturbation strategies that inadequately address the region-specific nature of facial manipulation in deepfakes.
format Preprint
id arxiv_https___arxiv_org_abs_2505_15336
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping
Yam, Hon Ming
Guo, Zhongliang
Lau, Chun Pong
Computer Vision and Pattern Recognition
The proliferation of diffusion-based deepfake technologies poses significant risks for unauthorized and unethical facial image manipulation. While traditional countermeasures have primarily focused on passive detection methods, this paper introduces a novel proactive defense strategy through adversarial attacks that preemptively protect facial images from being exploited by diffusion-based deepfake systems. Existing adversarial protection methods predominantly target conventional generative architectures (GANs, AEs, VAEs) and fail to address the unique challenges presented by diffusion models, which have become the predominant framework for high-quality facial deepfakes. Current diffusion-specific adversarial approaches are limited by their reliance on specific model architectures and weights, rendering them ineffective against the diverse landscape of diffusion-based deepfake implementations. Additionally, they typically employ global perturbation strategies that inadequately address the region-specific nature of facial manipulation in deepfakes.
title My Face Is Mine, Not Yours: Facial Protection Against Diffusion Model Face Swapping
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.15336