Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhao, Yimin, Gu, Jin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913398410706944
author Zhao, Yimin
Gu, Jin
author_facet Zhao, Yimin
Gu, Jin
contents An objective and accurate emotion diagnostic reference is vital to psychologists, especially when dealing with patients who are difficult to communicate with for pathological reasons. Nevertheless, current systems based on Electroencephalography (EEG) data utilized for sentiment discrimination have some problems, including excessive model complexity, mediocre accuracy, and limited interpretability. Consequently, we propose a novel and effective feature fusion mechanism named Mutual-Cross-Attention (MCA). Combining with a specially customized 3D Convolutional Neural Network (3D-CNN), this purely mathematical mechanism adeptly discovers the complementary relationship between time-domain and frequency-domain features in EEG data. Furthermore, the new designed Channel-PSD-DE 3D feature also contributes to the high performance. The proposed method eventually achieves 99.49% (valence) and 99.30% (arousal) accuracy on DEAP dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2406_14014
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion Recognition
Zhao, Yimin
Gu, Jin
Machine Learning
Artificial Intelligence
An objective and accurate emotion diagnostic reference is vital to psychologists, especially when dealing with patients who are difficult to communicate with for pathological reasons. Nevertheless, current systems based on Electroencephalography (EEG) data utilized for sentiment discrimination have some problems, including excessive model complexity, mediocre accuracy, and limited interpretability. Consequently, we propose a novel and effective feature fusion mechanism named Mutual-Cross-Attention (MCA). Combining with a specially customized 3D Convolutional Neural Network (3D-CNN), this purely mathematical mechanism adeptly discovers the complementary relationship between time-domain and frequency-domain features in EEG data. Furthermore, the new designed Channel-PSD-DE 3D feature also contributes to the high performance. The proposed method eventually achieves 99.49% (valence) and 99.30% (arousal) accuracy on DEAP dataset.
title Feature Fusion Based on Mutual-Cross-Attention Mechanism for EEG Emotion Recognition
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2406.14014