Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ahmad, Adnan, Nakisa, Bahareh, Rastgoo, Mohammad Naim
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908368487055360
author Ahmad, Adnan
Nakisa, Bahareh
Rastgoo, Mohammad Naim
author_facet Ahmad, Adnan
Nakisa, Bahareh
Rastgoo, Mohammad Naim
contents Emotion recognition through physiological signals such as electroencephalogram (EEG) has become an essential aspect of affective computing and provides an objective way to capture human emotions. However, physiological data characterized by cross-subject variability and noisy labels hinder the performance of emotion recognition models. Existing domain adaptation and continual learning methods struggle to address these issues, especially under realistic conditions where data is continuously streamed and unlabeled. To overcome these limitations, we propose a novel bi-level self-supervised continual learning framework, SSOCL, based on a dynamic memory buffer. This bi-level architecture iteratively refines the dynamic buffer and pseudo-label assignments to effectively retain representative samples, enabling generalization from continuous, unlabeled physiological data streams for emotion recognition. The assigned pseudo-labels are subsequently leveraged for accurate emotion prediction. Key components of the framework, including a fast adaptation module and a cluster-mapping module, enable robust learning and effective handling of evolving data streams. Experimental validation on two mainstream EEG tasks demonstrates the framework's ability to adapt to continuous data streams while maintaining strong generalization across subjects, outperforming existing approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10575
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning
Ahmad, Adnan
Nakisa, Bahareh
Rastgoo, Mohammad Naim
Computer Vision and Pattern Recognition
Machine Learning
Emotion recognition through physiological signals such as electroencephalogram (EEG) has become an essential aspect of affective computing and provides an objective way to capture human emotions. However, physiological data characterized by cross-subject variability and noisy labels hinder the performance of emotion recognition models. Existing domain adaptation and continual learning methods struggle to address these issues, especially under realistic conditions where data is continuously streamed and unlabeled. To overcome these limitations, we propose a novel bi-level self-supervised continual learning framework, SSOCL, based on a dynamic memory buffer. This bi-level architecture iteratively refines the dynamic buffer and pseudo-label assignments to effectively retain representative samples, enabling generalization from continuous, unlabeled physiological data streams for emotion recognition. The assigned pseudo-labels are subsequently leveraged for accurate emotion prediction. Key components of the framework, including a fast adaptation module and a cluster-mapping module, enable robust learning and effective handling of evolving data streams. Experimental validation on two mainstream EEG tasks demonstrates the framework's ability to adapt to continuous data streams while maintaining strong generalization across subjects, outperforming existing approaches.
title Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2505.10575