SafeEditor: Unified MLLM for Efficient Post-hoc T2I Safety Editing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Ruiyang, Luo, Jiahao, Feng, Xiaoru, Pang, Qiufan, Yang, Yaodong, Dai, Juntao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909875149209600
author Zhang, Ruiyang
Luo, Jiahao
Feng, Xiaoru
Pang, Qiufan
Yang, Yaodong
Dai, Juntao
author_facet Zhang, Ruiyang
Luo, Jiahao
Feng, Xiaoru
Pang, Qiufan
Yang, Yaodong
Dai, Juntao
contents With the rapid advancement of text-to-image (T2I) models, ensuring their safety has become increasingly critical. Existing safety approaches can be categorized into training-time and inference-time methods. While inference-time methods are widely adopted due to their cost-effectiveness, they often suffer from limitations such as over-refusal and imbalance between safety and utility. To address these challenges, we propose a multi-round safety editing framework that functions as a model-agnostic, plug-and-play module, enabling efficient safety alignment for any text-to-image model. Central to this framework is MR-SafeEdit, a multi-round image-text interleaved dataset specifically constructed for safety editing in text-to-image generation. We introduce a post-hoc safety editing paradigm that mirrors the human cognitive process of identifying and refining unsafe content. To instantiate this paradigm, we develop SafeEditor, a unified MLLM capable of multi-round safety editing on generated images. Experimental results show that SafeEditor surpasses prior safety approaches by reducing over-refusal while achieving a more favorable safety-utility balance.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24820
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SafeEditor: Unified MLLM for Efficient Post-hoc T2I Safety Editing
Zhang, Ruiyang
Luo, Jiahao
Feng, Xiaoru
Pang, Qiufan
Yang, Yaodong
Dai, Juntao
Computer Vision and Pattern Recognition
Artificial Intelligence
With the rapid advancement of text-to-image (T2I) models, ensuring their safety has become increasingly critical. Existing safety approaches can be categorized into training-time and inference-time methods. While inference-time methods are widely adopted due to their cost-effectiveness, they often suffer from limitations such as over-refusal and imbalance between safety and utility. To address these challenges, we propose a multi-round safety editing framework that functions as a model-agnostic, plug-and-play module, enabling efficient safety alignment for any text-to-image model. Central to this framework is MR-SafeEdit, a multi-round image-text interleaved dataset specifically constructed for safety editing in text-to-image generation. We introduce a post-hoc safety editing paradigm that mirrors the human cognitive process of identifying and refining unsafe content. To instantiate this paradigm, we develop SafeEditor, a unified MLLM capable of multi-round safety editing on generated images. Experimental results show that SafeEditor surpasses prior safety approaches by reducing over-refusal while achieving a more favorable safety-utility balance.
title SafeEditor: Unified MLLM for Efficient Post-hoc T2I Safety Editing
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2510.24820