On Deepfake Voice Detection -- It's All in the Presentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Delgado, Héctor, Ramondetti, Giorgio, Dalmasso, Emanuele, Karvitsky, Gennady, Colibro, Daniele, Talib, Haydar
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918385469620224
author Delgado, Héctor
Ramondetti, Giorgio
Dalmasso, Emanuele
Karvitsky, Gennady
Colibro, Daniele
Talib, Haydar
author_facet Delgado, Héctor
Ramondetti, Giorgio
Dalmasso, Emanuele
Karvitsky, Gennady
Colibro, Daniele
Talib, Haydar
contents While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights how current deepfake datasets and research methodologies led to systems that failed to generalize to real world application. The main reason is due to the difference between raw deepfake audio, and deepfake audio that has been presented through a communication channel, e.g. by phone. We propose a new framework for data creation and research methodology, allowing for the development of spoofing countermeasures that would be more effective in real-world scenarios. By following the guidelines outlined here we improved deepfake detection accuracy by 39% in more robust and realistic lab setups, and by 57% on a real-world benchmark. We also demonstrate how improvement in datasets would have a bigger impact on deepfake detection accuracy than the choice of larger SOTA models would over smaller models; that is, it would be more important for the scientific community to make greater investment on comprehensive data collection programs than to simply train larger models with higher computational demands.
format Preprint
id arxiv_https___arxiv_org_abs_2509_26471
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On Deepfake Voice Detection -- It's All in the Presentation
Delgado, Héctor
Ramondetti, Giorgio
Dalmasso, Emanuele
Karvitsky, Gennady
Colibro, Daniele
Talib, Haydar
Audio and Speech Processing
Artificial Intelligence
While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights how current deepfake datasets and research methodologies led to systems that failed to generalize to real world application. The main reason is due to the difference between raw deepfake audio, and deepfake audio that has been presented through a communication channel, e.g. by phone. We propose a new framework for data creation and research methodology, allowing for the development of spoofing countermeasures that would be more effective in real-world scenarios. By following the guidelines outlined here we improved deepfake detection accuracy by 39% in more robust and realistic lab setups, and by 57% on a real-world benchmark. We also demonstrate how improvement in datasets would have a bigger impact on deepfake detection accuracy than the choice of larger SOTA models would over smaller models; that is, it would be more important for the scientific community to make greater investment on comprehensive data collection programs than to simply train larger models with higher computational demands.
title On Deepfake Voice Detection -- It's All in the Presentation
topic Audio and Speech Processing
Artificial Intelligence
url https://arxiv.org/abs/2509.26471