Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liao, Yen-Lun, Chen, Xuanjun, Wang, Chung-Che, Jang, Jyh-Shing Roger
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910826097541120
author Liao, Yen-Lun
Chen, Xuanjun
Wang, Chung-Che
Jang, Jyh-Shing Roger
author_facet Liao, Yen-Lun
Chen, Xuanjun
Wang, Chung-Che
Jang, Jyh-Shing Roger
contents The countermeasure (CM) model is developed to protect ASV systems from spoof attacks and prevent resulting personal information leakage in Automatic Speaker Verification (ASV) system. Based on practicality and security considerations, the CM model is usually deployed on edge devices, which have more limited computing resources and storage space than cloud-based systems, confining the model size under a limitation. To better trade off the CM model sizes and performance, we proposed an adversarial speaker distillation method, which is an improved version of knowledge distillation method combined with generalized end-to-end (GE2E) pre-training and adversarial fine-tuning. In the evaluation phase of the ASVspoof 2021 Logical Access task, our proposed adversarial speaker distillation ResNetSE (ASD-ResNetSE) model reaches 0.2695 min t-DCF and 3.54% EER. ASD-ResNetSE only used 22.5% of parameters and 19.4% of multiply and accumulate operands of ResNetSE model.
format Preprint
id arxiv_https___arxiv_org_abs_2203_17031
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification
Liao, Yen-Lun
Chen, Xuanjun
Wang, Chung-Che
Jang, Jyh-Shing Roger
Sound
Machine Learning
Audio and Speech Processing
The countermeasure (CM) model is developed to protect ASV systems from spoof attacks and prevent resulting personal information leakage in Automatic Speaker Verification (ASV) system. Based on practicality and security considerations, the CM model is usually deployed on edge devices, which have more limited computing resources and storage space than cloud-based systems, confining the model size under a limitation. To better trade off the CM model sizes and performance, we proposed an adversarial speaker distillation method, which is an improved version of knowledge distillation method combined with generalized end-to-end (GE2E) pre-training and adversarial fine-tuning. In the evaluation phase of the ASVspoof 2021 Logical Access task, our proposed adversarial speaker distillation ResNetSE (ASD-ResNetSE) model reaches 0.2695 min t-DCF and 3.54% EER. ASD-ResNetSE only used 22.5% of parameters and 19.4% of multiply and accumulate operands of ResNetSE model.
title Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2203.17031