VoiceGrad: Non-Parallel Any-to-Many Voice Conversion with Annealed Langevin Dynamics
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2020
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916152970575872 |
|---|---|
| author | Kameoka, Hirokazu Kaneko, Takuhiro Tanaka, Kou Hojo, Nobukatsu Seki, Shogo |
| author_facet | Kameoka, Hirokazu Kaneko, Takuhiro Tanaka, Kou Hojo, Nobukatsu Seki, Shogo |
| contents | In this paper, we propose a non-parallel any-to-many voice conversion (VC) method termed VoiceGrad. Inspired by WaveGrad, a recently introduced novel waveform generation method, VoiceGrad is based upon the concepts of score matching and Langevin dynamics. It uses weighted denoising score matching to train a score approximator, a fully convolutional network with a U-Net structure designed to predict the gradient of the log density of the speech feature sequences of multiple speakers, and performs VC by using annealed Langevin dynamics to iteratively update an input feature sequence towards the nearest stationary point of the target distribution based on the trained score approximator network. Thanks to the nature of this concept, VoiceGrad enables any-to-many VC, a VC scenario in which the speaker of input speech can be arbitrary, and allows for non-parallel training, which requires no parallel utterances or transcriptions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2010_02977 |
| institution | arXiv |
| publishDate | 2020 |
| record_format | arxiv |
| spellingShingle | VoiceGrad: Non-Parallel Any-to-Many Voice Conversion with Annealed Langevin Dynamics Kameoka, Hirokazu Kaneko, Takuhiro Tanaka, Kou Hojo, Nobukatsu Seki, Shogo Sound Audio and Speech Processing In this paper, we propose a non-parallel any-to-many voice conversion (VC) method termed VoiceGrad. Inspired by WaveGrad, a recently introduced novel waveform generation method, VoiceGrad is based upon the concepts of score matching and Langevin dynamics. It uses weighted denoising score matching to train a score approximator, a fully convolutional network with a U-Net structure designed to predict the gradient of the log density of the speech feature sequences of multiple speakers, and performs VC by using annealed Langevin dynamics to iteratively update an input feature sequence towards the nearest stationary point of the target distribution based on the trained score approximator network. Thanks to the nature of this concept, VoiceGrad enables any-to-many VC, a VC scenario in which the speaker of input speech can be arbitrary, and allows for non-parallel training, which requires no parallel utterances or transcriptions. |
| title | VoiceGrad: Non-Parallel Any-to-Many Voice Conversion with Annealed Langevin Dynamics |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2010.02977 |