A Dataset and Baselines for Measuring and Predicting the Music Piece Memorability

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tseng, Li-Yang, Lin, Tzu-Ling, Shuai, Hong-Han, Huang, Jen-Wei, Chang, Wen-Whei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916254619533312
author Tseng, Li-Yang
Lin, Tzu-Ling
Shuai, Hong-Han
Huang, Jen-Wei
Chang, Wen-Whei
author_facet Tseng, Li-Yang
Lin, Tzu-Ling
Shuai, Hong-Han
Huang, Jen-Wei
Chang, Wen-Whei
contents Nowadays, humans are constantly exposed to music, whether through voluntary streaming services or incidental encounters during commercial breaks. Despite the abundance of music, certain pieces remain more memorable and often gain greater popularity. Inspired by this phenomenon, we focus on measuring and predicting music memorability. To achieve this, we collect a new music piece dataset with reliable memorability labels using a novel interactive experimental procedure. We then train baselines to predict and analyze music memorability, leveraging both interpretable features and audio mel-spectrograms as inputs. To the best of our knowledge, we are the first to explore music memorability using data-driven deep learning-based methods. Through a series of experiments and ablation studies, we demonstrate that while there is room for improvement, predicting music memorability with limited data is possible. Certain intrinsic elements, such as higher valence, arousal, and faster tempo, contribute to memorable music. As prediction techniques continue to evolve, real-life applications like music recommendation systems and music style transfer will undoubtedly benefit from this new area of research.
format Preprint
id arxiv_https___arxiv_org_abs_2405_12847
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Dataset and Baselines for Measuring and Predicting the Music Piece Memorability
Tseng, Li-Yang
Lin, Tzu-Ling
Shuai, Hong-Han
Huang, Jen-Wei
Chang, Wen-Whei
Information Retrieval
Machine Learning
Multimedia
Sound
Audio and Speech Processing
Nowadays, humans are constantly exposed to music, whether through voluntary streaming services or incidental encounters during commercial breaks. Despite the abundance of music, certain pieces remain more memorable and often gain greater popularity. Inspired by this phenomenon, we focus on measuring and predicting music memorability. To achieve this, we collect a new music piece dataset with reliable memorability labels using a novel interactive experimental procedure. We then train baselines to predict and analyze music memorability, leveraging both interpretable features and audio mel-spectrograms as inputs. To the best of our knowledge, we are the first to explore music memorability using data-driven deep learning-based methods. Through a series of experiments and ablation studies, we demonstrate that while there is room for improvement, predicting music memorability with limited data is possible. Certain intrinsic elements, such as higher valence, arousal, and faster tempo, contribute to memorable music. As prediction techniques continue to evolve, real-life applications like music recommendation systems and music style transfer will undoubtedly benefit from this new area of research.
title A Dataset and Baselines for Measuring and Predicting the Music Piece Memorability
topic Information Retrieval
Machine Learning
Multimedia
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2405.12847