Advancing Continual Learning for Robust Deepfake Audio Classification

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dong, Feiyi, Tang, Qingchen, Bai, Yichen, Wang, Zihan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917721613008896
author Dong, Feiyi
Tang, Qingchen
Bai, Yichen
Wang, Zihan
author_facet Dong, Feiyi
Tang, Qingchen
Bai, Yichen
Wang, Zihan
contents The emergence of new spoofing attacks poses an increasing challenge to audio security. Current detection methods often falter when faced with unseen spoofing attacks. Traditional strategies, such as retraining with new data, are not always feasible due to extensive storage. This paper introduces a novel continual learning method Continual Audio Defense Enhancer (CADE). First, by utilizing a fixed memory size to store randomly selected samples from previous datasets, our approach conserves resources and adheres to privacy constraints. Additionally, we also apply two distillation losses in CADE. By distillation in classifiers, CADE ensures that the student model closely resembles that of the teacher model. This resemblance helps the model retain old information while facing unseen data. We further refine our model's performance with a novel embedding similarity loss that extends across multiple depth layers, facilitating superior positive sample alignment. Experiments conducted on the ASVspoof2019 dataset show that our proposed method outperforms the baseline methods.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10108
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Advancing Continual Learning for Robust Deepfake Audio Classification
Dong, Feiyi
Tang, Qingchen
Bai, Yichen
Wang, Zihan
Audio and Speech Processing
Sound
The emergence of new spoofing attacks poses an increasing challenge to audio security. Current detection methods often falter when faced with unseen spoofing attacks. Traditional strategies, such as retraining with new data, are not always feasible due to extensive storage. This paper introduces a novel continual learning method Continual Audio Defense Enhancer (CADE). First, by utilizing a fixed memory size to store randomly selected samples from previous datasets, our approach conserves resources and adheres to privacy constraints. Additionally, we also apply two distillation losses in CADE. By distillation in classifiers, CADE ensures that the student model closely resembles that of the teacher model. This resemblance helps the model retain old information while facing unseen data. We further refine our model's performance with a novel embedding similarity loss that extends across multiple depth layers, facilitating superior positive sample alignment. Experiments conducted on the ASVspoof2019 dataset show that our proposed method outperforms the baseline methods.
title Advancing Continual Learning for Robust Deepfake Audio Classification
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2407.10108