Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jiang, Changjiang, Dong, Wenhui, Zhang, Zhonghao, Yu, Fengchang, Peng, Wei, Yuan, Xinbin, Bi, Yifei, Zhao, Ming, Zhou, Zian, Si, Chenyang, Shan, Caifeng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910191181627392
author Jiang, Changjiang
Dong, Wenhui
Zhang, Zhonghao
Yu, Fengchang
Peng, Wei
Yuan, Xinbin
Bi, Yifei
Zhao, Ming
Zhou, Zian
Si, Chenyang
Shan, Caifeng
author_facet Jiang, Changjiang
Dong, Wenhui
Zhang, Zhonghao
Yu, Fengchang
Peng, Wei
Yuan, Xinbin
Bi, Yifei
Zhao, Ming
Zhou, Zian
Si, Chenyang
Shan, Caifeng
contents The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major limitations: (1) the lack of multidimensional explainable datasets for generated images and videos. Existing open-source datasets (e.g., WildFake, GenVideo) rely on oversimplified binary annotations, which restrict the explainability and trustworthiness of trained detectors. (2) Prior MLLM-based forgery detectors (e.g., FakeVLM) exhibit insufficiently fine-grained interpretability in their step-by-step reasoning, which hinders reliable localization and explanation. To address these challenges, we introduce Ivy-Fake, the first large-scale multimodal benchmark for explainable AIGC detection. It consists of over 106K richly annotated training samples (images and videos) and 5,000 manually verified evaluation examples, sourced from multiple generative models and real world datasets through a carefully designed pipeline to ensure both diversity and quality. Furthermore, we propose Ivy-xDetector, a reinforcement learning model based on Group Relative Policy Optimization (GRPO), capable of producing explainable reasoning chains and achieving robust performance across multiple synthetic content detection benchmarks. Extensive experiments demonstrate the superiority of our dataset and confirm the effectiveness of our approach. Notably, our method improves performance on GenImage from 86.88% to 96.32%, surpassing prior state-of-the-art methods by a clear margin.
format Preprint
id arxiv_https___arxiv_org_abs_2506_00979
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
Jiang, Changjiang
Dong, Wenhui
Zhang, Zhonghao
Yu, Fengchang
Peng, Wei
Yuan, Xinbin
Bi, Yifei
Zhao, Ming
Zhou, Zian
Si, Chenyang
Shan, Caifeng
Computer Vision and Pattern Recognition
Artificial Intelligence
The rapid development of Artificial Intelligence Generated Content (AIGC) techniques has enabled the creation of high-quality synthetic content, but it also raises significant security concerns. Current detection methods face two major limitations: (1) the lack of multidimensional explainable datasets for generated images and videos. Existing open-source datasets (e.g., WildFake, GenVideo) rely on oversimplified binary annotations, which restrict the explainability and trustworthiness of trained detectors. (2) Prior MLLM-based forgery detectors (e.g., FakeVLM) exhibit insufficiently fine-grained interpretability in their step-by-step reasoning, which hinders reliable localization and explanation. To address these challenges, we introduce Ivy-Fake, the first large-scale multimodal benchmark for explainable AIGC detection. It consists of over 106K richly annotated training samples (images and videos) and 5,000 manually verified evaluation examples, sourced from multiple generative models and real world datasets through a carefully designed pipeline to ensure both diversity and quality. Furthermore, we propose Ivy-xDetector, a reinforcement learning model based on Group Relative Policy Optimization (GRPO), capable of producing explainable reasoning chains and achieving robust performance across multiple synthetic content detection benchmarks. Extensive experiments demonstrate the superiority of our dataset and confirm the effectiveness of our approach. Notably, our method improves performance on GenImage from 86.88% to 96.32%, surpassing prior state-of-the-art methods by a clear margin.
title Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2506.00979