A Universal Identity Backdoor Attack against Speaker Verification based on Siamese Network

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhao, Haodong, Du, Wei, Guo, Junjie, Liu, Gongshen
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929696198885376
author Zhao, Haodong
Du, Wei
Guo, Junjie
Liu, Gongshen
author_facet Zhao, Haodong
Du, Wei
Guo, Junjie
Liu, Gongshen
contents Speaker verification has been widely used in many authentication scenarios. However, training models for speaker verification requires large amounts of data and computing power, so users often use untrustworthy third-party data or deploy third-party models directly, which may create security risks. In this paper, we propose a backdoor attack for the above scenario. Specifically, for the Siamese network in the speaker verification system, we try to implant a universal identity in the model that can simulate any enrolled speaker and pass the verification. So the attacker does not need to know the victim, which makes the attack more flexible and stealthy. In addition, we design and compare three ways of selecting attacker utterances and two ways of poisoned training for the GE2E loss function in different scenarios. The results on the TIMIT and Voxceleb1 datasets show that our approach can achieve a high attack success rate while guaranteeing the normal verification accuracy. Our work reveals the vulnerability of the speaker verification system and provides a new perspective to further improve the robustness of the system.
format Preprint
id arxiv_https___arxiv_org_abs_2303_16031
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Universal Identity Backdoor Attack against Speaker Verification based on Siamese Network
Zhao, Haodong
Du, Wei
Guo, Junjie
Liu, Gongshen
Cryptography and Security
Sound
Audio and Speech Processing
Speaker verification has been widely used in many authentication scenarios. However, training models for speaker verification requires large amounts of data and computing power, so users often use untrustworthy third-party data or deploy third-party models directly, which may create security risks. In this paper, we propose a backdoor attack for the above scenario. Specifically, for the Siamese network in the speaker verification system, we try to implant a universal identity in the model that can simulate any enrolled speaker and pass the verification. So the attacker does not need to know the victim, which makes the attack more flexible and stealthy. In addition, we design and compare three ways of selecting attacker utterances and two ways of poisoned training for the GE2E loss function in different scenarios. The results on the TIMIT and Voxceleb1 datasets show that our approach can achieve a high attack success rate while guaranteeing the normal verification accuracy. Our work reveals the vulnerability of the speaker verification system and provides a new perspective to further improve the robustness of the system.
title A Universal Identity Backdoor Attack against Speaker Verification based on Siamese Network
topic Cryptography and Security
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2303.16031