Privacy-preserving Prosody Representation Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Everson, Kevin, Ostendorf, Mari
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917549595164672
author Everson, Kevin
Ostendorf, Mari
author_facet Everson, Kevin
Ostendorf, Mari
contents Speech representations that capture prosodic information can be useful for both understanding and generation. However, speaker characteristics are reflected in acoustic-prosodic features (e.g., pitch). To address privacy concerns from the leakage of identity information, we propose a new self-supervised approach to learning prosody representations that incorporates speaker disentanglement strategies. We evaluate our encoder on three tasks to probe representation capabilities, including pitch reconstruction and detection of different prosodic events. Our encoder outperforms raw prosody and HuBERT-base baselines, achieving strong speaker disentanglement without adverse impact on prosody-related downstream tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2606_00407
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Privacy-preserving Prosody Representation Learning
Everson, Kevin
Ostendorf, Mari
Audio and Speech Processing
Speech representations that capture prosodic information can be useful for both understanding and generation. However, speaker characteristics are reflected in acoustic-prosodic features (e.g., pitch). To address privacy concerns from the leakage of identity information, we propose a new self-supervised approach to learning prosody representations that incorporates speaker disentanglement strategies. We evaluate our encoder on three tasks to probe representation capabilities, including pitch reconstruction and detection of different prosodic events. Our encoder outperforms raw prosody and HuBERT-base baselines, achieving strong speaker disentanglement without adverse impact on prosody-related downstream tasks.
title Privacy-preserving Prosody Representation Learning
topic Audio and Speech Processing
url https://arxiv.org/abs/2606.00407