Advance Fake Video Detection via Vision Transformers

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Battocchio, Joy, Dell'Anna, Stefano, Montibeller, Andrea, Boato, Giulia
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910921782198272
author Battocchio, Joy
Dell'Anna, Stefano
Montibeller, Andrea
Boato, Giulia
author_facet Battocchio, Joy
Dell'Anna, Stefano
Montibeller, Andrea
Boato, Giulia
contents Recent advancements in AI-based multimedia generation have enabled the creation of hyper-realistic images and videos, raising concerns about their potential use in spreading misinformation. The widespread accessibility of generative techniques, which allow for the production of fake multimedia from prompts or existing media, along with their continuous refinement, underscores the urgent need for highly accurate and generalizable AI-generated media detection methods, underlined also by new regulations like the European Digital AI Act. In this paper, we draw inspiration from Vision Transformer (ViT)-based fake image detection and extend this idea to video. We propose an {original} %innovative framework that effectively integrates ViT embeddings over time to enhance detection performance. Our method shows promising accuracy, generalization, and few-shot learning capabilities across a new, large and diverse dataset of videos generated using five open source generative techniques from the state-of-the-art, as well as a separate dataset containing videos produced by proprietary generative methods.
format Preprint
id arxiv_https___arxiv_org_abs_2504_20669
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advance Fake Video Detection via Vision Transformers
Battocchio, Joy
Dell'Anna, Stefano
Montibeller, Andrea
Boato, Giulia
Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
Recent advancements in AI-based multimedia generation have enabled the creation of hyper-realistic images and videos, raising concerns about their potential use in spreading misinformation. The widespread accessibility of generative techniques, which allow for the production of fake multimedia from prompts or existing media, along with their continuous refinement, underscores the urgent need for highly accurate and generalizable AI-generated media detection methods, underlined also by new regulations like the European Digital AI Act. In this paper, we draw inspiration from Vision Transformer (ViT)-based fake image detection and extend this idea to video. We propose an {original} %innovative framework that effectively integrates ViT embeddings over time to enhance detection performance. Our method shows promising accuracy, generalization, and few-shot learning capabilities across a new, large and diverse dataset of videos generated using five open source generative techniques from the state-of-the-art, as well as a separate dataset containing videos produced by proprietary generative methods.
title Advance Fake Video Detection via Vision Transformers
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Multimedia
url https://arxiv.org/abs/2504.20669