Does Current Deepfake Audio Detection Model Effectively Detect ALM-based Deepfake Audio?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xie, Yuankun, Xiong, Chenxu, Wang, Xiaopeng, Wang, Zhiyong, Lu, Yi, Qi, Xin, Fu, Ruibo, Liu, Yukun, Wen, Zhengqi, Tao, Jianhua, Li, Guanjun, Ye, Long
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929466077347840
author Xie, Yuankun
Xiong, Chenxu
Wang, Xiaopeng
Wang, Zhiyong
Lu, Yi
Qi, Xin
Fu, Ruibo
Liu, Yukun
Wen, Zhengqi
Tao, Jianhua
Li, Guanjun
Ye, Long
author_facet Xie, Yuankun
Xiong, Chenxu
Wang, Xiaopeng
Wang, Zhiyong
Lu, Yi
Qi, Xin
Fu, Ruibo
Liu, Yukun
Wen, Zhengqi
Tao, Jianhua
Li, Guanjun
Ye, Long
contents Currently, Audio Language Models (ALMs) are rapidly advancing due to the developments in large language models and audio neural codecs. These ALMs have significantly lowered the barrier to creating deepfake audio, generating highly realistic and diverse types of deepfake audio, which pose severe threats to society. Consequently, effective audio deepfake detection technologies to detect ALM-based audio have become increasingly critical. This paper investigate the effectiveness of current countermeasure (CM) against ALM-based audio. Specifically, we collect 12 types of the latest ALM-based deepfake audio and utilizing the latest CMs to evaluate. Our findings reveal that the latest codec-trained CM can effectively detect ALM-based audio, achieving 0% equal error rate under most ALM test conditions, which exceeded our expectations. This indicates promising directions for future research in ALM-based deepfake audio detection.
format Preprint
id arxiv_https___arxiv_org_abs_2408_10853
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Does Current Deepfake Audio Detection Model Effectively Detect ALM-based Deepfake Audio?
Xie, Yuankun
Xiong, Chenxu
Wang, Xiaopeng
Wang, Zhiyong
Lu, Yi
Qi, Xin
Fu, Ruibo
Liu, Yukun
Wen, Zhengqi
Tao, Jianhua
Li, Guanjun
Ye, Long
Sound
Artificial Intelligence
Audio and Speech Processing
Currently, Audio Language Models (ALMs) are rapidly advancing due to the developments in large language models and audio neural codecs. These ALMs have significantly lowered the barrier to creating deepfake audio, generating highly realistic and diverse types of deepfake audio, which pose severe threats to society. Consequently, effective audio deepfake detection technologies to detect ALM-based audio have become increasingly critical. This paper investigate the effectiveness of current countermeasure (CM) against ALM-based audio. Specifically, we collect 12 types of the latest ALM-based deepfake audio and utilizing the latest CMs to evaluate. Our findings reveal that the latest codec-trained CM can effectively detect ALM-based audio, achieving 0% equal error rate under most ALM test conditions, which exceeded our expectations. This indicates promising directions for future research in ALM-based deepfake audio detection.
title Does Current Deepfake Audio Detection Model Effectively Detect ALM-based Deepfake Audio?
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2408.10853