GLA-Grad: A Griffin-Lim Extended Waveform Generation Diffusion Model
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914689899823104 |
|---|---|
| author | Liu, Haocheng Baoueb, Teysir Fontaine, Mathieu Roux, Jonathan Le Richard, Gael |
| author_facet | Liu, Haocheng Baoueb, Teysir Fontaine, Mathieu Roux, Jonathan Le Richard, Gael |
| contents | Diffusion models are receiving a growing interest for a variety of signal generation tasks such as speech or music synthesis. WaveGrad, for example, is a successful diffusion model that conditionally uses the mel spectrogram to guide a diffusion process for the generation of high-fidelity audio. However, such models face important challenges concerning the noise diffusion process for training and inference, and they have difficulty generating high-quality speech for speakers that were not seen during training. With the aim of minimizing the conditioning error and increasing the efficiency of the noise diffusion process, we propose in this paper a new scheme called GLA-Grad, which consists in introducing a phase recovery algorithm such as the Griffin-Lim algorithm (GLA) at each step of the regular diffusion process. Furthermore, it can be directly applied to an already-trained waveform generation model, without additional training or fine-tuning. We show that our algorithm outperforms state-of-the-art diffusion models for speech generation, especially when generating speech for a previously unseen target speaker. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_15516 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | GLA-Grad: A Griffin-Lim Extended Waveform Generation Diffusion Model Liu, Haocheng Baoueb, Teysir Fontaine, Mathieu Roux, Jonathan Le Richard, Gael Sound Machine Learning Audio and Speech Processing Signal Processing Diffusion models are receiving a growing interest for a variety of signal generation tasks such as speech or music synthesis. WaveGrad, for example, is a successful diffusion model that conditionally uses the mel spectrogram to guide a diffusion process for the generation of high-fidelity audio. However, such models face important challenges concerning the noise diffusion process for training and inference, and they have difficulty generating high-quality speech for speakers that were not seen during training. With the aim of minimizing the conditioning error and increasing the efficiency of the noise diffusion process, we propose in this paper a new scheme called GLA-Grad, which consists in introducing a phase recovery algorithm such as the Griffin-Lim algorithm (GLA) at each step of the regular diffusion process. Furthermore, it can be directly applied to an already-trained waveform generation model, without additional training or fine-tuning. We show that our algorithm outperforms state-of-the-art diffusion models for speech generation, especially when generating speech for a previously unseen target speaker. |
| title | GLA-Grad: A Griffin-Lim Extended Waveform Generation Diffusion Model |
| topic | Sound Machine Learning Audio and Speech Processing Signal Processing |
| url | https://arxiv.org/abs/2402.15516 |