Benchmarking Music Autotagging with MGPHot Expert Annotations vs. Generic Tag Datasets

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Ramoneda, Pedro, Alonso-Jiménez, Pablo, Oramas, Sergio, Serra, Xavier, Bogdanov, Dmitry
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912576640647168
author Ramoneda, Pedro
Alonso-Jiménez, Pablo
Oramas, Sergio
Serra, Xavier
Bogdanov, Dmitry
author_facet Ramoneda, Pedro
Alonso-Jiménez, Pablo
Oramas, Sergio
Serra, Xavier
Bogdanov, Dmitry
contents Music autotagging aims to automatically assign descriptive tags, such as genre, mood, or instrumentation, to audio recordings. Due to its challenges, diversity of semantic descriptions, and practical value in various applications, it has become a common downstream task for evaluating the performance of general-purpose music representations learned from audio data. We introduce a new benchmarking dataset based on the recently published MGPHot dataset, which includes expert musicological annotations, allowing for additional insights and comparisons with results obtained on common generic tag datasets. While MGPHot annotations have been shown to be useful for computational musicology, the original dataset neither includes audio nor provides evaluation setups for its use as a standardized autotagging benchmark. To address this, we provide a curated set of YouTube URLs with retrievable audio, and propose a train/val/test split for standardized evaluation, and precomputed representations for seven state-of-the-art models. Using these resources, we evaluated these models in MGPHot and standard reference tag datasets, highlighting key differences between expert and generic tag annotations. Altogether, our contributions provide a more advanced benchmarking framework for future research in music understanding.
format Preprint
id arxiv_https___arxiv_org_abs_2509_06936
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Benchmarking Music Autotagging with MGPHot Expert Annotations vs. Generic Tag Datasets
Ramoneda, Pedro
Alonso-Jiménez, Pablo
Oramas, Sergio
Serra, Xavier
Bogdanov, Dmitry
Sound
Audio and Speech Processing
Music autotagging aims to automatically assign descriptive tags, such as genre, mood, or instrumentation, to audio recordings. Due to its challenges, diversity of semantic descriptions, and practical value in various applications, it has become a common downstream task for evaluating the performance of general-purpose music representations learned from audio data. We introduce a new benchmarking dataset based on the recently published MGPHot dataset, which includes expert musicological annotations, allowing for additional insights and comparisons with results obtained on common generic tag datasets. While MGPHot annotations have been shown to be useful for computational musicology, the original dataset neither includes audio nor provides evaluation setups for its use as a standardized autotagging benchmark. To address this, we provide a curated set of YouTube URLs with retrievable audio, and propose a train/val/test split for standardized evaluation, and precomputed representations for seven state-of-the-art models. Using these resources, we evaluated these models in MGPHot and standard reference tag datasets, highlighting key differences between expert and generic tag annotations. Altogether, our contributions provide a more advanced benchmarking framework for future research in music understanding.
title Benchmarking Music Autotagging with MGPHot Expert Annotations vs. Generic Tag Datasets
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2509.06936