Enregistré dans:
Détails bibliographiques
Auteurs principaux: Pham, Loc Bao, Luong, Huong Hoang, Tran, Phu Thien, Ngo, Phuc Hoang, Nguyen, Vi Hoang, Nguyen, Thinh
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2410.20352
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929562237009920
author Pham, Loc Bao
Luong, Huong Hoang
Tran, Phu Thien
Ngo, Phuc Hoang
Nguyen, Vi Hoang
Nguyen, Thinh
author_facet Pham, Loc Bao
Luong, Huong Hoang
Tran, Phu Thien
Ngo, Phuc Hoang
Nguyen, Vi Hoang
Nguyen, Thinh
contents Melody stuck in your head, also known as "earworm", is tough to get rid of, unless you listen to it again or sing it out loud. But what if you can not find the name of that song? It must be an intolerable feeling. Recognizing a song name base on humming sound is not an easy task for a human being and should be done by machines. However, there is no research paper published about hum tune recognition. Adapting from Hum2Song Zalo AI Challenge 2021 - a competition about querying the name of a song by user's giving humming tune, which is similar to Google's Hum to Search. This paper covers details about the pre-processed data from the original type (mp3) to usable form for training and inference. In training an embedding model for the feature extraction phase, we ran experiments with some states of the art, such as ResNet, VGG, AlexNet, MobileNetV2. And for the inference phase, we use the Faiss module to effectively search for a song that matched the sequence of humming sound. The result comes at nearly 94\% in MRR@10 metric on the public test set, along with the top 1 result on the public leaderboard.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20352
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An approach to hummed-tune and song sequences matching
Pham, Loc Bao
Luong, Huong Hoang
Tran, Phu Thien
Ngo, Phuc Hoang
Nguyen, Vi Hoang
Nguyen, Thinh
Sound
Artificial Intelligence
Information Retrieval
Audio and Speech Processing
Melody stuck in your head, also known as "earworm", is tough to get rid of, unless you listen to it again or sing it out loud. But what if you can not find the name of that song? It must be an intolerable feeling. Recognizing a song name base on humming sound is not an easy task for a human being and should be done by machines. However, there is no research paper published about hum tune recognition. Adapting from Hum2Song Zalo AI Challenge 2021 - a competition about querying the name of a song by user's giving humming tune, which is similar to Google's Hum to Search. This paper covers details about the pre-processed data from the original type (mp3) to usable form for training and inference. In training an embedding model for the feature extraction phase, we ran experiments with some states of the art, such as ResNet, VGG, AlexNet, MobileNetV2. And for the inference phase, we use the Faiss module to effectively search for a song that matched the sequence of humming sound. The result comes at nearly 94\% in MRR@10 metric on the public test set, along with the top 1 result on the public leaderboard.
title An approach to hummed-tune and song sequences matching
topic Sound
Artificial Intelligence
Information Retrieval
Audio and Speech Processing
url https://arxiv.org/abs/2410.20352