Generation of Musical Timbres using a Text-Guided Diffusion Model
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916687523086336 |
|---|---|
| author | Yuan, Weixuan Khan, Qadeer Golkov, Vladimir |
| author_facet | Yuan, Weixuan Khan, Qadeer Golkov, Vladimir |
| contents | In recent years, text-to-audio systems have achieved remarkable success, enabling the generation of complete audio segments directly from text descriptions. While these systems also facilitate music creation, the element of human creativity and deliberate expression is often limited. In contrast, the present work allows composers, arrangers, and performers to create the basic building blocks for music creation: audio of individual musical notes for use in electronic instruments and DAWs. Through text prompts, the user can specify the timbre characteristics of the audio. We introduce a system that combines a latent diffusion model and multi-modal contrastive learning to generate musical timbres conditioned on text descriptions. By jointly generating the magnitude and phase of the spectrogram, our method eliminates the need for subsequently running a phase retrieval algorithm, as related methods do.
Audio examples, source code, and a web app are available at https://wxuanyuan.github.io/Musical-Note-Generation/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_09219 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Generation of Musical Timbres using a Text-Guided Diffusion Model Yuan, Weixuan Khan, Qadeer Golkov, Vladimir Sound Audio and Speech Processing H.5.5; I.2.7 In recent years, text-to-audio systems have achieved remarkable success, enabling the generation of complete audio segments directly from text descriptions. While these systems also facilitate music creation, the element of human creativity and deliberate expression is often limited. In contrast, the present work allows composers, arrangers, and performers to create the basic building blocks for music creation: audio of individual musical notes for use in electronic instruments and DAWs. Through text prompts, the user can specify the timbre characteristics of the audio. We introduce a system that combines a latent diffusion model and multi-modal contrastive learning to generate musical timbres conditioned on text descriptions. By jointly generating the magnitude and phase of the spectrogram, our method eliminates the need for subsequently running a phase retrieval algorithm, as related methods do. Audio examples, source code, and a web app are available at https://wxuanyuan.github.io/Musical-Note-Generation/ |
| title | Generation of Musical Timbres using a Text-Guided Diffusion Model |
| topic | Sound Audio and Speech Processing H.5.5; I.2.7 |
| url | https://arxiv.org/abs/2504.09219 |