Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bai, Haoyue, Sun, Yiyou, Cheng, Wei, Chen, Haifeng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911118294777856
author Bai, Haoyue
Sun, Yiyou
Cheng, Wei
Chen, Haifeng
author_facet Bai, Haoyue
Sun, Yiyou
Cheng, Wei
Chen, Haifeng
contents The recent proliferation of photorealistic images created by generative models has sparked both excitement and concern, as these images are increasingly indistinguishable from real ones to the human eye. While offering new creative and commercial possibilities, the potential for misuse, such as in misinformation and fraud, highlights the need for effective detection methods. Current detection approaches often rely on access to model weights or require extensive collections of real image datasets, limiting their scalability and practical application in real world scenarios. In this work, we introduce a novel black box detection framework that requires only API access, sidestepping the need for model weights or large auxiliary datasets. Our approach leverages a corrupt and recover strategy: by masking part of an image and assessing the model ability to reconstruct it, we measure the likelihood that the image was generated by the model itself. For black-box models that do not support masked image inputs, we incorporate a cost efficient surrogate model trained to align with the target model distribution, enhancing detection capability. Our framework demonstrates strong performance, outperforming baseline methods by 4.31% in mean average precision across eight diffusion model variant datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2505_01008
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content
Bai, Haoyue
Sun, Yiyou
Cheng, Wei
Chen, Haifeng
Machine Learning
The recent proliferation of photorealistic images created by generative models has sparked both excitement and concern, as these images are increasingly indistinguishable from real ones to the human eye. While offering new creative and commercial possibilities, the potential for misuse, such as in misinformation and fraud, highlights the need for effective detection methods. Current detection approaches often rely on access to model weights or require extensive collections of real image datasets, limiting their scalability and practical application in real world scenarios. In this work, we introduce a novel black box detection framework that requires only API access, sidestepping the need for model weights or large auxiliary datasets. Our approach leverages a corrupt and recover strategy: by masking part of an image and assessing the model ability to reconstruct it, we measure the likelihood that the image was generated by the model itself. For black-box models that do not support masked image inputs, we incorporate a cost efficient surrogate model trained to align with the target model distribution, enhancing detection capability. Our framework demonstrates strong performance, outperforming baseline methods by 4.31% in mean average precision across eight diffusion model variant datasets.
title Where's the liability in the Generative Era? Recovery-based Black-Box Detection of AI-Generated Content
topic Machine Learning
url https://arxiv.org/abs/2505.01008