Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xie, Yuankun, Fu, Ruibo, Wen, Zhengqi, Wang, Zhiyong, Wang, Xiaopeng, Cheng, Haonnan, Ye, Long, Tao, Jianhua
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917688230543360
author Xie, Yuankun
Fu, Ruibo
Wen, Zhengqi
Wang, Zhiyong
Wang, Xiaopeng
Cheng, Haonnan
Ye, Long
Tao, Jianhua
author_facet Xie, Yuankun
Fu, Ruibo
Wen, Zhengqi
Wang, Zhiyong
Wang, Xiaopeng
Cheng, Haonnan
Ye, Long
Tao, Jianhua
contents With the proliferation of deepfake audio, there is an urgent need to investigate their attribution. Current source tracing methods can effectively distinguish in-distribution (ID) categories. However, the rapid evolution of deepfake algorithms poses a critical challenge in the accurate identification of out-of-distribution (OOD) novel deepfake algorithms. In this paper, we propose Real Emphasis and Fake Dispersion (REFD) strategy for audio deepfake algorithm recognition, demonstrating its effectiveness in discriminating ID samples while identifying OOD samples. For effective OOD detection, we first explore current post-hoc OOD methods and propose NSD, a novel OOD approach in identifying novel deepfake algorithms through the similarity consideration of both feature and logits scores. REFD achieves 86.83% F1-score as a single system in Audio Deepfake Detection Challenge 2023 Track3, showcasing its state-of-the-art performance.
format Preprint
id arxiv_https___arxiv_org_abs_2406_03240
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
Xie, Yuankun
Fu, Ruibo
Wen, Zhengqi
Wang, Zhiyong
Wang, Xiaopeng
Cheng, Haonnan
Ye, Long
Tao, Jianhua
Sound
Artificial Intelligence
Audio and Speech Processing
With the proliferation of deepfake audio, there is an urgent need to investigate their attribution. Current source tracing methods can effectively distinguish in-distribution (ID) categories. However, the rapid evolution of deepfake algorithms poses a critical challenge in the accurate identification of out-of-distribution (OOD) novel deepfake algorithms. In this paper, we propose Real Emphasis and Fake Dispersion (REFD) strategy for audio deepfake algorithm recognition, demonstrating its effectiveness in discriminating ID samples while identifying OOD samples. For effective OOD detection, we first explore current post-hoc OOD methods and propose NSD, a novel OOD approach in identifying novel deepfake algorithms through the similarity consideration of both feature and logits scores. REFD achieves 86.83% F1-score as a single system in Audio Deepfake Detection Challenge 2023 Track3, showcasing its state-of-the-art performance.
title Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2406.03240