Towards Blind Data Cleaning: A Case Study in Music Source Separation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gui, Azalea, Choi, Woosung, Koo, Junghyun, Shimada, Kazuki, Shibuya, Takashi, Serrà, Joan, Liao, Wei-Hsiang, Mitsufuji, Yuki
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912654432403456
author Gui, Azalea
Choi, Woosung
Koo, Junghyun
Shimada, Kazuki
Shibuya, Takashi
Serrà, Joan
Liao, Wei-Hsiang
Mitsufuji, Yuki
author_facet Gui, Azalea
Choi, Woosung
Koo, Junghyun
Shimada, Kazuki
Shibuya, Takashi
Serrà, Joan
Liao, Wei-Hsiang
Mitsufuji, Yuki
contents The performance of deep learning models for music source separation heavily depends on training data quality. However, datasets are often corrupted by difficult-to-detect artifacts such as audio bleeding and label noise. Since the type and extent of contamination are typically unknown, cleaning methods targeting specific corruptions are often impractical. This paper proposes and evaluates two distinct, noise-agnostic data cleaning methods to address this challenge. The first approach uses data attribution via unlearning to identify and filter out training samples that contribute the least to producing clean outputs. The second leverages the Fréchet Audio Distance to measure and remove samples that are perceptually dissimilar to a small and trusted clean reference set. On a dataset contaminated with a simulated distribution of real-world noise, our unlearning-based methods produced a cleaned dataset and a corresponding model that outperforms both the original contaminated data and the small clean reference set used for cleaning. This result closes approximately 66.7\% of the performance gap between the contaminated baseline and a model trained on the same dataset without any contamination. Unlike methods tailored for specific artifacts, our noise-agnostic approaches offer a more generic and broadly applicable solution for curating high-quality training data.
format Preprint
id arxiv_https___arxiv_org_abs_2510_15409
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Blind Data Cleaning: A Case Study in Music Source Separation
Gui, Azalea
Choi, Woosung
Koo, Junghyun
Shimada, Kazuki
Shibuya, Takashi
Serrà, Joan
Liao, Wei-Hsiang
Mitsufuji, Yuki
Audio and Speech Processing
The performance of deep learning models for music source separation heavily depends on training data quality. However, datasets are often corrupted by difficult-to-detect artifacts such as audio bleeding and label noise. Since the type and extent of contamination are typically unknown, cleaning methods targeting specific corruptions are often impractical. This paper proposes and evaluates two distinct, noise-agnostic data cleaning methods to address this challenge. The first approach uses data attribution via unlearning to identify and filter out training samples that contribute the least to producing clean outputs. The second leverages the Fréchet Audio Distance to measure and remove samples that are perceptually dissimilar to a small and trusted clean reference set. On a dataset contaminated with a simulated distribution of real-world noise, our unlearning-based methods produced a cleaned dataset and a corresponding model that outperforms both the original contaminated data and the small clean reference set used for cleaning. This result closes approximately 66.7\% of the performance gap between the contaminated baseline and a model trained on the same dataset without any contamination. Unlike methods tailored for specific artifacts, our noise-agnostic approaches offer a more generic and broadly applicable solution for curating high-quality training data.
title Towards Blind Data Cleaning: A Case Study in Music Source Separation
topic Audio and Speech Processing
url https://arxiv.org/abs/2510.15409