Energy-based features and bi-LSTM neural network for EEG-based music and voice classification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ariza, Isaac, Barbancho, Ana M., Tardon, Lorenzo J., Barbancho, Isabel
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913581882146816
author Ariza, Isaac
Barbancho, Ana M.
Tardon, Lorenzo J.
Barbancho, Isabel
author_facet Ariza, Isaac
Barbancho, Ana M.
Tardon, Lorenzo J.
Barbancho, Isabel
contents The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this manuscript is to advance in the classification of brain responses to music of diverse genres and to sounds of different nature: speech and music. For this purpose, two different experiments have been designed to acquiere EEG signals from subjects listening to songs of different musical genres and sentences in various languages. With this, a novel scheme is proposed to characterize brain signals for their classification; this scheme is based on the construction of a feature matrix built on relations between energy measured at the different EEG channels and the usage of a bi-LSTM neural network. With the data obtained, evaluations regarding EEG-based classification between speech and music, different musical genres, and whether the subject likes the song listened to or not are carried out. The experiments unveil satisfactory performance to the proposed scheme. The results obtained for binary audio type classification attain 98.66% of success. In multi-class classification between 4 musical genres, the accuracy attained is 61.59%, and results for binary classification of musical taste rise to 96.96%.
format Preprint
id arxiv_https___arxiv_org_abs_2411_13217
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Energy-based features and bi-LSTM neural network for EEG-based music and voice classification
Ariza, Isaac
Barbancho, Ana M.
Tardon, Lorenzo J.
Barbancho, Isabel
Signal Processing
Sound
Audio and Speech Processing
68
G.3; I.5
The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this manuscript is to advance in the classification of brain responses to music of diverse genres and to sounds of different nature: speech and music. For this purpose, two different experiments have been designed to acquiere EEG signals from subjects listening to songs of different musical genres and sentences in various languages. With this, a novel scheme is proposed to characterize brain signals for their classification; this scheme is based on the construction of a feature matrix built on relations between energy measured at the different EEG channels and the usage of a bi-LSTM neural network. With the data obtained, evaluations regarding EEG-based classification between speech and music, different musical genres, and whether the subject likes the song listened to or not are carried out. The experiments unveil satisfactory performance to the proposed scheme. The results obtained for binary audio type classification attain 98.66% of success. In multi-class classification between 4 musical genres, the accuracy attained is 61.59%, and results for binary classification of musical taste rise to 96.96%.
title Energy-based features and bi-LSTM neural network for EEG-based music and voice classification
topic Signal Processing
Sound
Audio and Speech Processing
68
G.3; I.5
url https://arxiv.org/abs/2411.13217