Automatic Music Sample Identification with Multi-Track Contrastive Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Riou, Alain, Serrà, Joan, Mitsufuji, Yuki
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909870626701312
author Riou, Alain
Serrà, Joan
Mitsufuji, Yuki
author_facet Riou, Alain
Serrà, Joan
Mitsufuji, Yuki
contents Sampling, the technique of reusing pieces of existing audio tracks to create new music content, is a very common practice in modern music production. In this paper, we tackle the challenging task of automatic sample identification, that is, detecting such sampled content and retrieving the material from which it originates. To do so, we adopt a self-supervised learning approach that leverages a multi-track dataset to create positive pairs of artificial mixes, and design a novel contrastive learning objective. We show that such method significantly outperforms previous state-of-the-art baselines, that is robust to various genres, and that scales well when increasing the number of noise songs in the reference database. In addition, we extensively analyze the contribution of the different components of our training pipeline and highlight, in particular, the need for high-quality separated stems for this task.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11507
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Automatic Music Sample Identification with Multi-Track Contrastive Learning
Riou, Alain
Serrà, Joan
Mitsufuji, Yuki
Sound
Artificial Intelligence
Machine Learning
Audio and Speech Processing
Sampling, the technique of reusing pieces of existing audio tracks to create new music content, is a very common practice in modern music production. In this paper, we tackle the challenging task of automatic sample identification, that is, detecting such sampled content and retrieving the material from which it originates. To do so, we adopt a self-supervised learning approach that leverages a multi-track dataset to create positive pairs of artificial mixes, and design a novel contrastive learning objective. We show that such method significantly outperforms previous state-of-the-art baselines, that is robust to various genres, and that scales well when increasing the number of noise songs in the reference database. In addition, we extensively analyze the contribution of the different components of our training pipeline and highlight, in particular, the need for high-quality separated stems for this task.
title Automatic Music Sample Identification with Multi-Track Contrastive Learning
topic Sound
Artificial Intelligence
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2510.11507