A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917705661022208 |
|---|---|
| author | Hung, Tzu-Yun Wu, Jui-Te Kuo, Yu-Chia Hsiao, Yo-Wei Lin, Ting-Wei Su, Li |
| author_facet | Hung, Tzu-Yun Wu, Jui-Te Kuo, Yu-Chia Hsiao, Yo-Wei Lin, Ting-Wei Su, Li |
| contents | Expressive music synthesis (EMS) for violin performance is a challenging task due to the disagreement among music performers in the interpretation of expressive musical terms (EMTs), scarcity of labeled recordings, and limited generalization ability of the synthesis model. These challenges create trade-offs between model effectiveness, diversity of generated results, and controllability of the synthesis system, making it essential to conduct a comparative study on EMS model design. This paper explores two violin EMS approaches. The end-to-end approach is a modification of a state-of-the-art text-to-speech generator. The parameter-controlled approach is based on a simple parameter sampling process that can render note lengths and other parameters compatible with MIDI-DDSP. We study these two approaches (in total, three model variants) through objective and subjective experiments and discuss several key issues of EMS based on the results. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_18089 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons Hung, Tzu-Yun Wu, Jui-Te Kuo, Yu-Chia Hsiao, Yo-Wei Lin, Ting-Wei Su, Li Sound Multimedia Audio and Speech Processing Expressive music synthesis (EMS) for violin performance is a challenging task due to the disagreement among music performers in the interpretation of expressive musical terms (EMTs), scarcity of labeled recordings, and limited generalization ability of the synthesis model. These challenges create trade-offs between model effectiveness, diversity of generated results, and controllability of the synthesis system, making it essential to conduct a comparative study on EMS model design. This paper explores two violin EMS approaches. The end-to-end approach is a modification of a state-of-the-art text-to-speech generator. The parameter-controlled approach is based on a simple parameter sampling process that can render note lengths and other parameters compatible with MIDI-DDSP. We study these two approaches (in total, three model variants) through objective and subjective experiments and discuss several key issues of EMS based on the results. |
| title | A Study on Synthesizing Expressive Violin Performances: Approaches and Comparisons |
| topic | Sound Multimedia Audio and Speech Processing |
| url | https://arxiv.org/abs/2406.18089 |