Music Auto-Tagging with Robust Music Representation Learned via Domain Adversarial Training

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Joung, Haesun, Lee, Kyogu
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917576924200960
author Joung, Haesun
Lee, Kyogu
author_facet Joung, Haesun
Lee, Kyogu
contents Music auto-tagging is crucial for enhancing music discovery and recommendation. Existing models in Music Information Retrieval (MIR) struggle with real-world noise such as environmental and speech sounds in multimedia content. This study proposes a method inspired by speech-related tasks to enhance music auto-tagging performance in noisy settings. The approach integrates Domain Adversarial Training (DAT) into the music domain, enabling robust music representations that withstand noise. Unlike previous research, this approach involves an additional pretraining phase for the domain classifier, to avoid performance degradation in the subsequent phase. Adding various synthesized noisy music data improves the model's generalization across different noise levels. The proposed architecture demonstrates enhanced performance in music auto-tagging by effectively utilizing unlabeled noisy music data. Additional experiments with supplementary unlabeled data further improves the model's performance, underscoring its robust generalization capabilities and broad applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15323
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Music Auto-Tagging with Robust Music Representation Learned via Domain Adversarial Training
Joung, Haesun
Lee, Kyogu
Sound
Artificial Intelligence
Information Retrieval
Audio and Speech Processing
Music auto-tagging is crucial for enhancing music discovery and recommendation. Existing models in Music Information Retrieval (MIR) struggle with real-world noise such as environmental and speech sounds in multimedia content. This study proposes a method inspired by speech-related tasks to enhance music auto-tagging performance in noisy settings. The approach integrates Domain Adversarial Training (DAT) into the music domain, enabling robust music representations that withstand noise. Unlike previous research, this approach involves an additional pretraining phase for the domain classifier, to avoid performance degradation in the subsequent phase. Adding various synthesized noisy music data improves the model's generalization across different noise levels. The proposed architecture demonstrates enhanced performance in music auto-tagging by effectively utilizing unlabeled noisy music data. Additional experiments with supplementary unlabeled data further improves the model's performance, underscoring its robust generalization capabilities and broad applicability.
title Music Auto-Tagging with Robust Music Representation Learned via Domain Adversarial Training
topic Sound
Artificial Intelligence
Information Retrieval
Audio and Speech Processing
url https://arxiv.org/abs/2401.15323