Saved in:
Bibliographic Details
Main Authors: Tan, Binhong, Wang, Zhaoxin, Wang, Handing
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.22041
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908918799663104
author Tan, Binhong
Wang, Zhaoxin
Wang, Handing
author_facet Tan, Binhong
Wang, Zhaoxin
Wang, Handing
contents Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic token-level intervention in the text embedding space, which fails to capture malicious semantics distributed across the full token sequence and remains vulnerable to adversarial prompts. In this paper, we propose DTVI, a dual-stage inference-time defense framework for safe T2I generation. Unlike existing methods that intervene on specific token embeddings, our method introduces category-aware sequence-level intervention on the full prompt embedding to better capture distributed malicious semantics, and further attenuates the remaining unsafe influences during the visual generation stage. Experimental results on real-world unsafe prompts, adversarial prompts, and multiple harmful categories show that our method achieves effective and robust defense while preserving reasonable generation quality on benign prompts, obtaining an average Defense Success Rate (DSR) of 94.43% across sexual-category benchmarks and 88.56 across seven unsafe categories, while maintaining generation quality on benign prompts.
format Preprint
id arxiv_https___arxiv_org_abs_2603_22041
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DTVI: Dual-Stage Textual and Visual Intervention for Safe Text-to-Image Generation
Tan, Binhong
Wang, Zhaoxin
Wang, Handing
Computer Vision and Pattern Recognition
Text-to-Image (T2I) diffusion models have demonstrated strong generation ability, but their potential to generate unsafe content raises significant safety concerns. Existing inference-time defense methods typically perform category-agnostic token-level intervention in the text embedding space, which fails to capture malicious semantics distributed across the full token sequence and remains vulnerable to adversarial prompts. In this paper, we propose DTVI, a dual-stage inference-time defense framework for safe T2I generation. Unlike existing methods that intervene on specific token embeddings, our method introduces category-aware sequence-level intervention on the full prompt embedding to better capture distributed malicious semantics, and further attenuates the remaining unsafe influences during the visual generation stage. Experimental results on real-world unsafe prompts, adversarial prompts, and multiple harmful categories show that our method achieves effective and robust defense while preserving reasonable generation quality on benign prompts, obtaining an average Defense Success Rate (DSR) of 94.43% across sexual-category benchmarks and 88.56 across seven unsafe categories, while maintaining generation quality on benign prompts.
title DTVI: Dual-Stage Textual and Visual Intervention for Safe Text-to-Image Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.22041