Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lian, Puwei, Cai, Yujun, Li, Songze, Bao, Bingkun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913170205966336
author Lian, Puwei
Cai, Yujun
Li, Songze
Bao, Bingkun
author_facet Lian, Puwei
Cai, Yujun
Li, Songze
Bao, Bingkun
contents Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether specific data was utilized during a model's training phase. As current MIAs for diffusion models typically exploit the model's image prediction ability, we formalize them into a unified general paradigm that computes the membership score for membership identification. Under this paradigm, we empirically find that existing attacks overlook the inherent deficiency in how diffusion models process high-frequency information. Consequently, this deficiency leads to member data with more high-frequency content being misclassified as hold-out data, and hold-out data with less high-frequency content tends to be misclassified as member data. Moreover, we theoretically demonstrate that this deficiency reduces the membership advantage of attacks, thereby interfering with the effective discrimination of member data and hold-out data. Based on this insight, we propose a plug-and-play high-frequency filter module to mitigate the adverse effects of the deficiency, which can be seamlessly integrated into any attacks within the general paradigm without additional time costs. Extensive experiments corroborate that this module significantly improves the performance of baseline attacks across different datasets and models. Code is available at https://github.com/poetic2/FreMIA.
format Preprint
id arxiv_https___arxiv_org_abs_2505_20955
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective
Lian, Puwei
Cai, Yujun
Li, Songze
Bao, Bingkun
Cryptography and Security
Machine Learning
Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether specific data was utilized during a model's training phase. As current MIAs for diffusion models typically exploit the model's image prediction ability, we formalize them into a unified general paradigm that computes the membership score for membership identification. Under this paradigm, we empirically find that existing attacks overlook the inherent deficiency in how diffusion models process high-frequency information. Consequently, this deficiency leads to member data with more high-frequency content being misclassified as hold-out data, and hold-out data with less high-frequency content tends to be misclassified as member data. Moreover, we theoretically demonstrate that this deficiency reduces the membership advantage of attacks, thereby interfering with the effective discrimination of member data and hold-out data. Based on this insight, we propose a plug-and-play high-frequency filter module to mitigate the adverse effects of the deficiency, which can be seamlessly integrated into any attacks within the general paradigm without additional time costs. Extensive experiments corroborate that this module significantly improves the performance of baseline attacks across different datasets and models. Code is available at https://github.com/poetic2/FreMIA.
title Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2505.20955