BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Weilin, Zhou, Nanjun, Wang, Yanyun, Li, Jianze, Xiong, Hui, Liu, Li
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909697736441856
author Lin, Weilin
Zhou, Nanjun
Wang, Yanyun
Li, Jianze
Xiong, Hui
Liu, Li
author_facet Lin, Weilin
Zhou, Nanjun
Wang, Yanyun
Li, Jianze
Xiong, Hui
Liu, Li
contents Backdoor learning is a critical research topic for understanding the vulnerabilities of deep neural networks. While the diffusion model (DM) has been broadly deployed in public over the past few years, the understanding of its backdoor vulnerability is still in its infancy compared to the extensive studies in discriminative models. Recently, many different backdoor attack and defense methods have been proposed for DMs, but a comprehensive benchmark for backdoor learning on DMs is still lacking. This absence makes it difficult to conduct fair comparisons and thorough evaluations of the existing approaches, thus hindering future research progress. To address this issue, we propose \textit{BackdoorDM}, the first comprehensive benchmark designed for backdoor learning on DMs. It comprises nine state-of-the-art (SOTA) attack methods, four SOTA defense strategies, and three useful visualization analysis tools. We first systematically classify and formulate the existing literature in a unified framework, focusing on three different backdoor attack types and five backdoor target types, which are restricted to a single type in discriminative models. Then, we systematically summarize the evaluation metrics for each type and propose a unified backdoor evaluation method based on multimodal large language model (MLLM). Finally, we conduct a comprehensive evaluation and highlight several important conclusions. We believe that BackdoorDM will help overcome current barriers and contribute to building a trustworthy artificial intelligence generated content (AIGC) community. The codes are released in https://github.com/linweiii/BackdoorDM.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11798
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model
Lin, Weilin
Zhou, Nanjun
Wang, Yanyun
Li, Jianze
Xiong, Hui
Liu, Li
Cryptography and Security
Backdoor learning is a critical research topic for understanding the vulnerabilities of deep neural networks. While the diffusion model (DM) has been broadly deployed in public over the past few years, the understanding of its backdoor vulnerability is still in its infancy compared to the extensive studies in discriminative models. Recently, many different backdoor attack and defense methods have been proposed for DMs, but a comprehensive benchmark for backdoor learning on DMs is still lacking. This absence makes it difficult to conduct fair comparisons and thorough evaluations of the existing approaches, thus hindering future research progress. To address this issue, we propose \textit{BackdoorDM}, the first comprehensive benchmark designed for backdoor learning on DMs. It comprises nine state-of-the-art (SOTA) attack methods, four SOTA defense strategies, and three useful visualization analysis tools. We first systematically classify and formulate the existing literature in a unified framework, focusing on three different backdoor attack types and five backdoor target types, which are restricted to a single type in discriminative models. Then, we systematically summarize the evaluation metrics for each type and propose a unified backdoor evaluation method based on multimodal large language model (MLLM). Finally, we conduct a comprehensive evaluation and highlight several important conclusions. We believe that BackdoorDM will help overcome current barriers and contribute to building a trustworthy artificial intelligence generated content (AIGC) community. The codes are released in https://github.com/linweiii/BackdoorDM.
title BackdoorDM: A Comprehensive Benchmark for Backdoor Learning on Diffusion Model
topic Cryptography and Security
url https://arxiv.org/abs/2502.11798