SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ba, Zhongjie, Zhong, Jieming, Lei, Jiachen, Cheng, Peng, Wang, Qinglong, Qin, Zhan, Wang, Zhibo, Ren, Kui
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929547166875648
author Ba, Zhongjie
Zhong, Jieming
Lei, Jiachen
Cheng, Peng
Wang, Qinglong
Qin, Zhan
Wang, Zhibo
Ren, Kui
author_facet Ba, Zhongjie
Zhong, Jieming
Lei, Jiachen
Cheng, Peng
Wang, Qinglong
Qin, Zhan
Wang, Zhibo
Ren, Kui
contents Advanced text-to-image models such as DALL$\cdot$E 2 and Midjourney possess the capacity to generate highly realistic images, raising significant concerns regarding the potential proliferation of unsafe content. This includes adult, violent, or deceptive imagery of political figures. Despite claims of rigorous safety mechanisms implemented in these models to restrict the generation of not-safe-for-work (NSFW) content, we successfully devise and exhibit the first prompt attacks on Midjourney, resulting in the production of abundant photorealistic NSFW images. We reveal the fundamental principles of such prompt attacks and suggest strategically substituting high-risk sections within a suspect prompt to evade closed-source safety measures. Our novel framework, SurrogatePrompt, systematically generates attack prompts, utilizing large language models, image-to-text, and image-to-image modules to automate attack prompt creation at scale. Evaluation results disclose an 88% success rate in bypassing Midjourney's proprietary safety filter with our attack prompts, leading to the generation of counterfeit images depicting political figures in violent scenarios. Both subjective and objective assessments validate that the images generated from our attack prompts present considerable safety hazards.
format Preprint
id arxiv_https___arxiv_org_abs_2309_14122
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitution
Ba, Zhongjie
Zhong, Jieming
Lei, Jiachen
Cheng, Peng
Wang, Qinglong
Qin, Zhan
Wang, Zhibo
Ren, Kui
Computer Vision and Pattern Recognition
Cryptography and Security
Advanced text-to-image models such as DALL$\cdot$E 2 and Midjourney possess the capacity to generate highly realistic images, raising significant concerns regarding the potential proliferation of unsafe content. This includes adult, violent, or deceptive imagery of political figures. Despite claims of rigorous safety mechanisms implemented in these models to restrict the generation of not-safe-for-work (NSFW) content, we successfully devise and exhibit the first prompt attacks on Midjourney, resulting in the production of abundant photorealistic NSFW images. We reveal the fundamental principles of such prompt attacks and suggest strategically substituting high-risk sections within a suspect prompt to evade closed-source safety measures. Our novel framework, SurrogatePrompt, systematically generates attack prompts, utilizing large language models, image-to-text, and image-to-image modules to automate attack prompt creation at scale. Evaluation results disclose an 88% success rate in bypassing Midjourney's proprietary safety filter with our attack prompts, leading to the generation of counterfeit images depicting political figures in violent scenarios. Both subjective and objective assessments validate that the images generated from our attack prompts present considerable safety hazards.
title SurrogatePrompt: Bypassing the Safety Filter of Text-to-Image Models via Substitution
topic Computer Vision and Pattern Recognition
Cryptography and Security
url https://arxiv.org/abs/2309.14122