MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912436746977280 |
|---|---|
| author | Louro, Pedro Lima Redinho, Hugo Santos, Ricardo Malheiro, Ricardo Panda, Renato Paiva, Rui Pedro |
| author_facet | Louro, Pedro Lima Redinho, Hugo Santos, Ricardo Malheiro, Ricardo Panda, Renato Paiva, Rui Pedro |
| contents | The Music Emotion Recognition (MER) field has seen steady developments in recent years, with contributions from feature engineering, machine learning, and deep learning. The landscape has also shifted from audio-centric systems to bimodal ensembles that combine audio and lyrics. However, a lack of public, sizable and quality-controlled bimodal databases has hampered the development and improvement of bimodal audio-lyrics systems. This article proposes three new audio, lyrics, and bimodal MER research datasets, collectively referred to as MERGE, which were created using a semi-automatic approach. To comprehensively assess the proposed datasets and establish a baseline for benchmarking, we conducted several experiments for each modality, using feature engineering, machine learning, and deep learning methodologies. Additionally, we propose and validate fixed train-validation-test splits. The obtained results confirm the viability of the proposed datasets, achieving the best overall result of 81.74\% F1-score for bimodal classification. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_06060 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition Louro, Pedro Lima Redinho, Hugo Santos, Ricardo Malheiro, Ricardo Panda, Renato Paiva, Rui Pedro Sound Information Retrieval Machine Learning Multimedia Audio and Speech Processing The Music Emotion Recognition (MER) field has seen steady developments in recent years, with contributions from feature engineering, machine learning, and deep learning. The landscape has also shifted from audio-centric systems to bimodal ensembles that combine audio and lyrics. However, a lack of public, sizable and quality-controlled bimodal databases has hampered the development and improvement of bimodal audio-lyrics systems. This article proposes three new audio, lyrics, and bimodal MER research datasets, collectively referred to as MERGE, which were created using a semi-automatic approach. To comprehensively assess the proposed datasets and establish a baseline for benchmarking, we conducted several experiments for each modality, using feature engineering, machine learning, and deep learning methodologies. Additionally, we propose and validate fixed train-validation-test splits. The obtained results confirm the viability of the proposed datasets, achieving the best overall result of 81.74\% F1-score for bimodal classification. |
| title | MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition |
| topic | Sound Information Retrieval Machine Learning Multimedia Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.06060 |