Diff-MSTC: A Mixing Style Transfer Prototype for Cubase
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910693050023936 |
|---|---|
| author | Vanka, Soumya Sai Hannink, Lennart Rolland, Jean-Baptiste Fazekas, George |
| author_facet | Vanka, Soumya Sai Hannink, Lennart Rolland, Jean-Baptiste Fazekas, George |
| contents | In our demo, participants are invited to explore the Diff-MSTC prototype, which integrates the Diff-MST model into Steinberg's digital audio workstation (DAW), Cubase. Diff-MST, a deep learning model for mixing style transfer, forecasts mixing console parameters for tracks using a reference song. The system processes up to 20 raw tracks along with a reference song to predict mixing console parameters that can be used to create an initial mix. Users have the option to manually adjust these parameters further for greater control. In contrast to earlier deep learning systems that are limited to research ideas, Diff-MSTC is a first-of-its-kind prototype integrated into a DAW. This integration facilitates mixing decisions on multitracks and lets users input context through a reference song, followed by fine-tuning of audio effects in a traditional manner. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_06576 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Diff-MSTC: A Mixing Style Transfer Prototype for Cubase Vanka, Soumya Sai Hannink, Lennart Rolland, Jean-Baptiste Fazekas, George Audio and Speech Processing Sound In our demo, participants are invited to explore the Diff-MSTC prototype, which integrates the Diff-MST model into Steinberg's digital audio workstation (DAW), Cubase. Diff-MST, a deep learning model for mixing style transfer, forecasts mixing console parameters for tracks using a reference song. The system processes up to 20 raw tracks along with a reference song to predict mixing console parameters that can be used to create an initial mix. Users have the option to manually adjust these parameters further for greater control. In contrast to earlier deep learning systems that are limited to research ideas, Diff-MSTC is a first-of-its-kind prototype integrated into a DAW. This integration facilitates mixing decisions on multitracks and lets users input context through a reference song, followed by fine-tuning of audio effects in a traditional manner. |
| title | Diff-MSTC: A Mixing Style Transfer Prototype for Cubase |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2411.06576 |