Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Rui, Chen, Liping, Lee, Kong AiK, Ling, Zhen-Hua
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929588345503744
author Wang, Rui
Chen, Liping
Lee, Kong AiK
Ling, Zhen-Hua
author_facet Wang, Rui
Chen, Liping
Lee, Kong AiK
Ling, Zhen-Hua
contents Voice anonymization has been developed as a technique for preserving privacy by replacing the speaker's voice in a speech signal with that of a pseudo-speaker, thereby obscuring the original voice attributes from machine recognition and human perception. In this paper, we focus on altering the voice attributes against machine recognition while retaining human perception. We referred to this as the asynchronous voice anonymization. To this end, a speech generation framework incorporating a speaker disentanglement mechanism is employed to generate the anonymized speech. The speaker attributes are altered through adversarial perturbation applied on the speaker embedding, while human perception is preserved by controlling the intensity of perturbation. Experiments conducted on the LibriSpeech dataset showed that the speaker attributes were obscured with their human perception preserved for 60.71% of the processed utterances.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08200
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding
Wang, Rui
Chen, Liping
Lee, Kong AiK
Ling, Zhen-Hua
Sound
Artificial Intelligence
Audio and Speech Processing
Voice anonymization has been developed as a technique for preserving privacy by replacing the speaker's voice in a speech signal with that of a pseudo-speaker, thereby obscuring the original voice attributes from machine recognition and human perception. In this paper, we focus on altering the voice attributes against machine recognition while retaining human perception. We referred to this as the asynchronous voice anonymization. To this end, a speech generation framework incorporating a speaker disentanglement mechanism is employed to generate the anonymized speech. The speaker attributes are altered through adversarial perturbation applied on the speaker embedding, while human perception is preserved by controlling the intensity of perturbation. Experiments conducted on the LibriSpeech dataset showed that the speaker attributes were obscured with their human perception preserved for 60.71% of the processed utterances.
title Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2406.08200