Saved in:
Bibliographic Details
Main Authors: Yan, Rui, Li, Yibo, Ding, Han, Wang, Fei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.05293
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909999571140608
author Yan, Rui
Li, Yibo
Ding, Han
Wang, Fei
author_facet Yan, Rui
Li, Yibo
Ding, Han
Wang, Fei
contents Electroencephalogram (EEG)-based emotion recognition is vital for affective computing but faces challenges in feature utilization and cross-domain generalization. This work introduces EmotionCLIP, which reformulates recognition as an EEG-text matching task within the CLIP framework. A tailored backbone, SST-LegoViT, captures spatial, spectral, and temporal features using multi-scale convolution and Transformer modules. Experiments on SEED and SEED-IV datasets show superior cross-subject accuracies of 88.69\% and 73.50\%, and cross-time accuracies of 88.46\% and 77.54\%, outperforming existing models. Results demonstrate the effectiveness of multimodal contrastive learning for robust EEG emotion recognition. The code is available at https://github.com/Departure2021/EmotionCLIP.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05293
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cross-domain EEG-based Emotion Recognition with Contrastive Learning
Yan, Rui
Li, Yibo
Ding, Han
Wang, Fei
Computer Vision and Pattern Recognition
Electroencephalogram (EEG)-based emotion recognition is vital for affective computing but faces challenges in feature utilization and cross-domain generalization. This work introduces EmotionCLIP, which reformulates recognition as an EEG-text matching task within the CLIP framework. A tailored backbone, SST-LegoViT, captures spatial, spectral, and temporal features using multi-scale convolution and Transformer modules. Experiments on SEED and SEED-IV datasets show superior cross-subject accuracies of 88.69\% and 73.50\%, and cross-time accuracies of 88.46\% and 77.54\%, outperforming existing models. Results demonstrate the effectiveness of multimodal contrastive learning for robust EEG emotion recognition. The code is available at https://github.com/Departure2021/EmotionCLIP.
title Cross-domain EEG-based Emotion Recognition with Contrastive Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.05293