An Emotion Recognition Framework via Cross-modal Alignment of EEG and Eye Movement Data

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Jianlu, Wang, Yanan, Liu, Tong
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915481394348032
author Wang, Jianlu
Wang, Yanan
Liu, Tong
author_facet Wang, Jianlu
Wang, Yanan
Liu, Tong
contents Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this limitation, we propose an emotion recognition framework that achieves accurate multimodal alignment of Electroencephalogram (EEG) and eye movement data through a hybrid architecture based on cross-modal attention mechanism. Experiments on the SEED-IV dataset demonstrate that our method achieve 90.62% accuracy. This work provides a promising foundation for leveraging multimodal data in emotion recognition
format Preprint
id arxiv_https___arxiv_org_abs_2509_04938
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Emotion Recognition Framework via Cross-modal Alignment of EEG and Eye Movement Data
Wang, Jianlu
Wang, Yanan
Liu, Tong
Multimedia
Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this limitation, we propose an emotion recognition framework that achieves accurate multimodal alignment of Electroencephalogram (EEG) and eye movement data through a hybrid architecture based on cross-modal attention mechanism. Experiments on the SEED-IV dataset demonstrate that our method achieve 90.62% accuracy. This work provides a promising foundation for leveraging multimodal data in emotion recognition
title An Emotion Recognition Framework via Cross-modal Alignment of EEG and Eye Movement Data
topic Multimedia
url https://arxiv.org/abs/2509.04938