Speech privacy-preserving methods using secret key for convolutional neural network models and their robustness evaluation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Niwa, Shoko, Shiota, Sayaka, Kiya, Hitoshi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929451756945408
author Niwa, Shoko
Shiota, Sayaka
Kiya, Hitoshi
author_facet Niwa, Shoko
Shiota, Sayaka
Kiya, Hitoshi
contents In this paper, we propose privacy-preserving methods with a secret key for convolutional neural network (CNN)-based models in speech processing tasks. In environments where untrusted third parties, like cloud servers, provide CNN-based systems, ensuring the privacy of speech queries becomes essential. This paper proposes encryption methods for speech queries using secret keys and a model structure that allows for encrypted queries to be accepted without decryption. Our approach introduces three types of secret keys: Shuffling, Flipping, and random orthogonal matrix (ROM). In experiments, we demonstrate that when the proposed methods are used with the correct key, identification performance did not degrade. Conversely, when an incorrect key is used, the performance significantly decreased. Particularly, with the use of ROM, we show that even with a relatively small key space, high privacy-preserving performance can be maintained many speech processing tasks. Furthermore, we also demonstrate the difficulty of recovering original speech from encrypted queries in various robustness evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2408_03897
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Speech privacy-preserving methods using secret key for convolutional neural network models and their robustness evaluation
Niwa, Shoko
Shiota, Sayaka
Kiya, Hitoshi
Audio and Speech Processing
Cryptography and Security
Sound
In this paper, we propose privacy-preserving methods with a secret key for convolutional neural network (CNN)-based models in speech processing tasks. In environments where untrusted third parties, like cloud servers, provide CNN-based systems, ensuring the privacy of speech queries becomes essential. This paper proposes encryption methods for speech queries using secret keys and a model structure that allows for encrypted queries to be accepted without decryption. Our approach introduces three types of secret keys: Shuffling, Flipping, and random orthogonal matrix (ROM). In experiments, we demonstrate that when the proposed methods are used with the correct key, identification performance did not degrade. Conversely, when an incorrect key is used, the performance significantly decreased. Particularly, with the use of ROM, we show that even with a relatively small key space, high privacy-preserving performance can be maintained many speech processing tasks. Furthermore, we also demonstrate the difficulty of recovering original speech from encrypted queries in various robustness evaluations.
title Speech privacy-preserving methods using secret key for convolutional neural network models and their robustness evaluation
topic Audio and Speech Processing
Cryptography and Security
Sound
url https://arxiv.org/abs/2408.03897