Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915373780041728 |
|---|---|
| author | Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard |
| author_facet | Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard |
| contents | Generative models of music audio are typically used to generate output based solely on a text prompt or melody. Boomerang sampling, recently proposed for the image domain, allows generating output close to an existing example, using any pretrained diffusion model. In this work, we explore its application in the audio domain as a tool for data augmentation or content manipulation. Specifically, implementing Boomerang sampling for Stable Audio Open, we augment training data for a state-of-the-art beat tracker, and attempt to replace musical instruments in recordings. Our results show that the rhythmic structure of existing examples is mostly preserved, that it improves performance of the beat tracker, but only in scenarios of limited training data, and that it can accomplish text-based instrument replacement on monophonic inputs. We publish our implementation to invite experiments on data augmentation in other tasks and explore further applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_04864 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation Fichtinger, Alexander Schlüter, Jan Widmer, Gerhard Sound Machine Learning Audio and Speech Processing Generative models of music audio are typically used to generate output based solely on a text prompt or melody. Boomerang sampling, recently proposed for the image domain, allows generating output close to an existing example, using any pretrained diffusion model. In this work, we explore its application in the audio domain as a tool for data augmentation or content manipulation. Specifically, implementing Boomerang sampling for Stable Audio Open, we augment training data for a state-of-the-art beat tracker, and attempt to replace musical instruments in recordings. Our results show that the rhythmic structure of existing examples is mostly preserved, that it improves performance of the beat tracker, but only in scenarios of limited training data, and that it can accomplish text-based instrument replacement on monophonic inputs. We publish our implementation to invite experiments on data augmentation in other tasks and explore further applications. |
| title | Music Boomerang: Reusing Diffusion Models for Data Augmentation and Audio Manipulation |
| topic | Sound Machine Learning Audio and Speech Processing |
| url | https://arxiv.org/abs/2507.04864 |