Latent Filling: Latent Space Data Augmentation for Zero-shot Speech Synthesis
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916099721789440 |
|---|---|
| author | Bae, Jae-Sung Lee, Joun Yeop Lee, Ji-Hyun Mun, Seongkyu Kang, Taehwa Cho, Hoon-Young Kim, Chanwoo |
| author_facet | Bae, Jae-Sung Lee, Joun Yeop Lee, Ji-Hyun Mun, Seongkyu Kang, Taehwa Cho, Hoon-Young Kim, Chanwoo |
| contents | Previous works in zero-shot text-to-speech (ZS-TTS) have attempted to enhance its systems by enlarging the training data through crowd-sourcing or augmenting existing speech data. However, the use of low-quality data has led to a decline in the overall system performance. To avoid such degradation, instead of directly augmenting the input data, we propose a latent filling (LF) method that adopts simple but effective latent space data augmentation in the speaker embedding space of the ZS-TTS system. By incorporating a consistency loss, LF can be seamlessly integrated into existing ZS-TTS systems without the need for additional training stages. Experimental results show that LF significantly improves speaker similarity while preserving speech quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_03538 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Latent Filling: Latent Space Data Augmentation for Zero-shot Speech Synthesis Bae, Jae-Sung Lee, Joun Yeop Lee, Ji-Hyun Mun, Seongkyu Kang, Taehwa Cho, Hoon-Young Kim, Chanwoo Audio and Speech Processing Previous works in zero-shot text-to-speech (ZS-TTS) have attempted to enhance its systems by enlarging the training data through crowd-sourcing or augmenting existing speech data. However, the use of low-quality data has led to a decline in the overall system performance. To avoid such degradation, instead of directly augmenting the input data, we propose a latent filling (LF) method that adopts simple but effective latent space data augmentation in the speaker embedding space of the ZS-TTS system. By incorporating a consistency loss, LF can be seamlessly integrated into existing ZS-TTS systems without the need for additional training stages. Experimental results show that LF significantly improves speaker similarity while preserving speech quality. |
| title | Latent Filling: Latent Space Data Augmentation for Zero-shot Speech Synthesis |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2310.03538 |