End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Fei, Wu, Xuecheng, Zhang, Zheng, Huang, Danlei, Huang, Yuheng, Wang, Bo
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915501273251840
author Wang, Fei
Wu, Xuecheng
Zhang, Zheng
Huang, Danlei
Huang, Yuheng
Wang, Bo
author_facet Wang, Fei
Wu, Xuecheng
Zhang, Zheng
Huang, Danlei
Huang, Yuheng
Wang, Bo
contents The powerful generative capabilities of diffusion models have significantly advanced the field of image synthesis, enhancing both full image generation and inpainting-based image editing. Despite their remarkable advancements, diffusion models also raise concerns about potential misuse for malicious purposes. However, existing approaches struggle to identify images generated by diffusion-based inpainting models, even when similar inpainted images are included in their training data. To address this challenge, we propose a novel detection method based on End-to-end denoising diffusion (End4). Specifically, End4 designs a denoising reconstruction model to improve the alignment degree between the latent spaces of the reconstruction and detection processes, thus reconstructing features that are more conducive to detection. Meanwhile, it leverages a Scale-aware Pyramid-like Fusion Module (SPFM) that refines local image features under the guidance of attention pyramid layers at different scales, enhancing feature discriminability. Additionally, to evaluate detection performance on inpainted images, we establish a comprehensive benchmark comprising images generated from five distinct masked regions. Extensive experiments demonstrate that our End4 effectively generalizes to unseen masking patterns and remains robust under various perturbations. Our code and dataset will be released soon.
format Preprint
id arxiv_https___arxiv_org_abs_2509_13214
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection
Wang, Fei
Wu, Xuecheng
Zhang, Zheng
Huang, Danlei
Huang, Yuheng
Wang, Bo
Computer Vision and Pattern Recognition
The powerful generative capabilities of diffusion models have significantly advanced the field of image synthesis, enhancing both full image generation and inpainting-based image editing. Despite their remarkable advancements, diffusion models also raise concerns about potential misuse for malicious purposes. However, existing approaches struggle to identify images generated by diffusion-based inpainting models, even when similar inpainted images are included in their training data. To address this challenge, we propose a novel detection method based on End-to-end denoising diffusion (End4). Specifically, End4 designs a denoising reconstruction model to improve the alignment degree between the latent spaces of the reconstruction and detection processes, thus reconstructing features that are more conducive to detection. Meanwhile, it leverages a Scale-aware Pyramid-like Fusion Module (SPFM) that refines local image features under the guidance of attention pyramid layers at different scales, enhancing feature discriminability. Additionally, to evaluate detection performance on inpainted images, we establish a comprehensive benchmark comprising images generated from five distinct masked regions. Extensive experiments demonstrate that our End4 effectively generalizes to unseen masking patterns and remains robust under various perturbations. Our code and dataset will be released soon.
title End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.13214