Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2409.09988 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913501414424576 |
|---|---|
| author | Hyodo, Hiroaki Takamichi, Shinnosuke Nakamura, Tomohiko Koguchi, Junya Saruwatari, Hiroshi |
| author_facet | Hyodo, Hiroaki Takamichi, Shinnosuke Nakamura, Tomohiko Koguchi, Junya Saruwatari, Hiroshi |
| contents | We propose a singing voice synthesis (SVS) method for a more unified ensemble singing voice by modeling interactions between singers. Most existing SVS methods aim to synthesize a solo voice, and do not consider interactions between singers, i.e., adjusting one's own voice to the others' voices. Since the production of ensemble voices from solo singing voices ignores the interactions, it can degrade the unity of the vocal ensemble. Therefore, we propose a SVS that reproduces the interactions. It is based on an architecture that uses musical scores of multiple voice parts, and loss functions that simulate the interactions' effect to acoustic features. Experimental results show that our methods improve the unity of the vocal ensemble. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_09988 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DNN-based ensemble singing voice synthesis with interactions between singers Hyodo, Hiroaki Takamichi, Shinnosuke Nakamura, Tomohiko Koguchi, Junya Saruwatari, Hiroshi Audio and Speech Processing Sound We propose a singing voice synthesis (SVS) method for a more unified ensemble singing voice by modeling interactions between singers. Most existing SVS methods aim to synthesize a solo voice, and do not consider interactions between singers, i.e., adjusting one's own voice to the others' voices. Since the production of ensemble voices from solo singing voices ignores the interactions, it can degrade the unity of the vocal ensemble. Therefore, we propose a SVS that reproduces the interactions. It is based on an architecture that uses musical scores of multiple voice parts, and loss functions that simulate the interactions' effect to acoustic features. Experimental results show that our methods improve the unity of the vocal ensemble. |
| title | DNN-based ensemble singing voice synthesis with interactions between singers |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2409.09988 |