How Noise Benefits AI-generated Image Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Ziqiang, Yan, Jiazhen, Wang, Fan, Zeng, Kai, Fu, Zhangjie
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910117903990784
author Li, Ziqiang
Yan, Jiazhen
Wang, Fan
Zeng, Kai
Fu, Zhangjie
author_facet Li, Ziqiang
Yan, Jiazhen
Wang, Fan
Zeng, Kai
Fu, Zhangjie
contents The rapid advancement of generative models has made real and synthetic images increasingly indistinguishable. Although extensive efforts have been devoted to detecting AI-generated images, out-of-distribution generalization remains a persistent challenge. We trace this weakness to spurious shortcuts exploited during training and we also observe that small feature-space perturbations can mitigate shortcut dominance. To address this problem in a more controllable manner, we propose the Positive-Incentive Noise for CLIP (PiN-CLIP), which jointly trains a noise generator and a detection network under a variational positive-incentive principle. Specifically, we construct positive-incentive noise in the feature space via cross-attention fusion of visual and categorical semantic features. During optimization, the noise is injected into the feature space to fine-tune the visual encoder, suppressing shortcut-sensitive directions while amplifying stable forensic cues, thereby enabling the extraction of more robust and generalized artifact representations. Comparative experiments are conducted on an open-world dataset comprising synthetic images generated by 42 distinct generative models. Our method achieves new state-of-the-art performance, with notable improvements of 5.4 in average accuracy over existing approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2511_16136
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle How Noise Benefits AI-generated Image Detection
Li, Ziqiang
Yan, Jiazhen
Wang, Fan
Zeng, Kai
Fu, Zhangjie
Computer Vision and Pattern Recognition
The rapid advancement of generative models has made real and synthetic images increasingly indistinguishable. Although extensive efforts have been devoted to detecting AI-generated images, out-of-distribution generalization remains a persistent challenge. We trace this weakness to spurious shortcuts exploited during training and we also observe that small feature-space perturbations can mitigate shortcut dominance. To address this problem in a more controllable manner, we propose the Positive-Incentive Noise for CLIP (PiN-CLIP), which jointly trains a noise generator and a detection network under a variational positive-incentive principle. Specifically, we construct positive-incentive noise in the feature space via cross-attention fusion of visual and categorical semantic features. During optimization, the noise is injected into the feature space to fine-tune the visual encoder, suppressing shortcut-sensitive directions while amplifying stable forensic cues, thereby enabling the extraction of more robust and generalized artifact representations. Comparative experiments are conducted on an open-world dataset comprising synthetic images generated by 42 distinct generative models. Our method achieves new state-of-the-art performance, with notable improvements of 5.4 in average accuracy over existing approaches.
title How Noise Benefits AI-generated Image Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.16136