Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shen, Xinke, Gan, Runmin, Wang, Kaixuan, Yang, Shuyi, Zhang, Qingzhu, Liu, Quanying, Zhang, Dan, Song, Sen
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913573579522048
author Shen, Xinke
Gan, Runmin
Wang, Kaixuan
Yang, Shuyi
Zhang, Qingzhu
Liu, Quanying
Zhang, Dan
Song, Sen
author_facet Shen, Xinke
Gan, Runmin
Wang, Kaixuan
Yang, Shuyi
Zhang, Qingzhu
Liu, Quanying
Zhang, Dan
Song, Sen
contents Electroencephalogram (EEG)-based emotion decoding can objectively quantify people's emotional state and has broad application prospects in human-computer interaction and early detection of emotional disorders. Recently emerging deep learning architectures have significantly improved the performance of EEG emotion decoding. However, existing methods still fall short of fully capturing the complex spatiotemporal dynamics of neural signals, which are crucial for representing emotion processing. This study proposes a Dynamic-Attention-based EEG State Transition (DAEST) modeling method to characterize EEG spatiotemporal dynamics. The model extracts spatiotemporal components of EEG that represent multiple parallel neural processes and estimates dynamic attention weights on these components to capture transitions in brain states. The model is optimized within a contrastive learning framework for cross-subject emotion recognition. The proposed method achieved state-of-the-art performance on three publicly available datasets: FACED, SEED, and SEED-V. It achieved 75.4% accuracy in the binary classification of positive and negative emotions and 59.3% in nine-class discrete emotion classification on the FACED dataset, 88.1% in the three-class classification of positive, negative, and neutral emotions on the SEED dataset, and 73.6% in five-class discrete emotion classification on the SEED-V dataset. The learned EEG spatiotemporal patterns and dynamic transition properties offer valuable insights into neural dynamics underlying emotion processing.
format Preprint
id arxiv_https___arxiv_org_abs_2411_04568
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition
Shen, Xinke
Gan, Runmin
Wang, Kaixuan
Yang, Shuyi
Zhang, Qingzhu
Liu, Quanying
Zhang, Dan
Song, Sen
Human-Computer Interaction
Signal Processing
Neurons and Cognition
Electroencephalogram (EEG)-based emotion decoding can objectively quantify people's emotional state and has broad application prospects in human-computer interaction and early detection of emotional disorders. Recently emerging deep learning architectures have significantly improved the performance of EEG emotion decoding. However, existing methods still fall short of fully capturing the complex spatiotemporal dynamics of neural signals, which are crucial for representing emotion processing. This study proposes a Dynamic-Attention-based EEG State Transition (DAEST) modeling method to characterize EEG spatiotemporal dynamics. The model extracts spatiotemporal components of EEG that represent multiple parallel neural processes and estimates dynamic attention weights on these components to capture transitions in brain states. The model is optimized within a contrastive learning framework for cross-subject emotion recognition. The proposed method achieved state-of-the-art performance on three publicly available datasets: FACED, SEED, and SEED-V. It achieved 75.4% accuracy in the binary classification of positive and negative emotions and 59.3% in nine-class discrete emotion classification on the FACED dataset, 88.1% in the three-class classification of positive, negative, and neutral emotions on the SEED dataset, and 73.6% in five-class discrete emotion classification on the SEED-V dataset. The learned EEG spatiotemporal patterns and dynamic transition properties offer valuable insights into neural dynamics underlying emotion processing.
title Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition
topic Human-Computer Interaction
Signal Processing
Neurons and Cognition
url https://arxiv.org/abs/2411.04568