Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915117644382208 |
|---|---|
| author | Bae, Jae-Sung Kuznetsova, Anastasia Manocha, Dinesh Hershey, John Kristjansson, Trausti Kim, Minje |
| author_facet | Bae, Jae-Sung Kuznetsova, Anastasia Manocha, Dinesh Hershey, John Kristjansson, Trausti Kim, Minje |
| contents | This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation workshop at ICASSP 2025. Collecting high-quality personalized data is challenging due to privacy concerns and technical difficulties in recording audio from the test scene. To address these issues, synthetic data generation using generative models has gained significant attention. In this challenge, participants are tasked first with building zero-shot TTS systems to augment personalized data. Subsequently, PSE systems are asked to be trained with this augmented personalized dataset. Through this challenge, we aim to investigate how the quality of augmented data generated by zero-shot TTS models affects PSE model performance. We also provide baseline experiments using open-source zero-shot TTS models to encourage participation and benchmark advancements. Our baseline code implementation and checkpoints are available online. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_13372 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement Bae, Jae-Sung Kuznetsova, Anastasia Manocha, Dinesh Hershey, John Kristjansson, Trausti Kim, Minje Audio and Speech Processing Artificial Intelligence This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation workshop at ICASSP 2025. Collecting high-quality personalized data is challenging due to privacy concerns and technical difficulties in recording audio from the test scene. To address these issues, synthetic data generation using generative models has gained significant attention. In this challenge, participants are tasked first with building zero-shot TTS systems to augment personalized data. Subsequently, PSE systems are asked to be trained with this augmented personalized dataset. Through this challenge, we aim to investigate how the quality of augmented data generated by zero-shot TTS models affects PSE model performance. We also provide baseline experiments using open-source zero-shot TTS models to encourage participation and benchmark advancements. Our baseline code implementation and checkpoints are available online. |
| title | Generative Data Augmentation Challenge: Zero-Shot Speech Synthesis for Personalized Speech Enhancement |
| topic | Audio and Speech Processing Artificial Intelligence |
| url | https://arxiv.org/abs/2501.13372 |