Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915373780041728 |
|---|---|
| author | Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard |
| author_facet | Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard |
| contents | Generative models of music audio are typically used to generate output based solely on a text prompt or melody. Boomerang sampling, recently proposed for the image domain, allows generating output close to an existing example, using any pretrained diffusion model. In this work, we explore its application in the audio domain as a tool for data augmentation or content manipulation. Specifically, implementing Boomerang sampling for Stable Audio Open, we augment training data for a state-of-the-art beat tracker, and attempt to replace musical instruments in recordings. Our results show that the rhythmic structure of existing examples is mostly preserved, that it improves performance of the beat tracker, but only in scenarios of limited training data, and that it can accomplish text-based instrument replacement on monophonic inputs. We publish our implementation to invite experiments on data augmentation in other tasks and explore further applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_04864 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard Sound Machine Learning Audio and Speech Processing Generative models of music audio are typically used to generate output based solely on a text prompt or melody. Boomerang sampling, recently proposed for the image domain, allows generating output close to an existing example, using any pretrained diffusion model. In this work, we explore its application in the audio domain as a tool for data augmentation or content manipulation. Specifically, implementing Boomerang sampling for Stable Audio Open, we augment training data for a state-of-the-art beat tracker, and attempt to replace musical instruments in recordings. Our results show that the rhythmic structure of existing examples is mostly preserved, that it improves performance of the beat tracker, but only in scenarios of limited training data, and that it can accomplish text-based instrument replacement on monophonic inputs. We publish our implementation to invite experiments on data augmentation in other tasks and explore further applications. |
| title | Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation |
| topic | Sound Machine Learning Audio and Speech Processing |
| url | https://arxiv.org/abs/2507.04864 |