TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911549414703104 |
|---|---|
| author | Jiang-Lin, Jian-Yu Huang, Kang-Yang Zou, Ling Lo, Ling Yang, Sheng-Ping Tseng, Yu-Wen Lin, Kun-Hsiang Chen, Chia-Ling Ta, Yu-Ting Wang, Yan-Tsung Chen, Po-Ching Xie, Hongxia Shuai, Hong-Han Cheng, Wen-Huang |
| author_facet | Jiang-Lin, Jian-Yu Huang, Kang-Yang Zou, Ling Lo, Ling Yang, Sheng-Ping Tseng, Yu-Wen Lin, Kun-Hsiang Chen, Chia-Ling Ta, Yu-Ting Wang, Yan-Tsung Chen, Po-Ching Xie, Hongxia Shuai, Hong-Han Cheng, Wen-Huang |
| contents | Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_10652 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection Jiang-Lin, Jian-Yu Huang, Kang-Yang Zou, Ling Lo, Ling Yang, Sheng-Ping Tseng, Yu-Wen Lin, Kun-Hsiang Chen, Chia-Ling Ta, Yu-Ting Wang, Yan-Tsung Chen, Po-Ching Xie, Hongxia Shuai, Hong-Han Cheng, Wen-Huang Computer Vision and Pattern Recognition Cryptography and Security Advances in generative modeling have made it increasingly easy to fabricate realistic portrayals of individuals, creating serious risks for security, communication, and public trust. Detecting such person-driven manipulations requires systems that not only distinguish altered content from authentic media but also provide clear and reliable reasoning. In this paper, we introduce TriDF, a comprehensive benchmark for interpretable DeepFake detection. TriDF contains high-quality forgeries from advanced synthesis models, covering 16 DeepFake types across image, video, and audio modalities. The benchmark evaluates three key aspects: Perception, which measures the ability of a model to identify fine-grained manipulation artifacts using human-annotated evidence; Detection, which assesses classification performance across diverse forgery families and generators; and Hallucination, which quantifies the reliability of model-generated explanations. Experiments on state-of-the-art multimodal large language models show that accurate perception is essential for reliable detection, but hallucination can severely disrupt decision-making, revealing the interdependence of these three aspects. TriDF provides a unified framework for understanding the interaction between detection accuracy, evidence identification, and explanation reliability, offering a foundation for building trustworthy systems that address real-world synthetic media threats. |
| title | TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection |
| topic | Computer Vision and Pattern Recognition Cryptography and Security |
| url | https://arxiv.org/abs/2512.10652 |