Dual Stream Independence Decoupling for True Emotion Recognition under Masked Expressions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wei, Jinsheng, Zhang, Xiguang, Shi, Zheng, Lu, Guanming
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917350293372928
author Wei, Jinsheng
Zhang, Xiguang
Shi, Zheng
Lu, Guanming
author_facet Wei, Jinsheng
Zhang, Xiguang
Shi, Zheng
Lu, Guanming
contents Recongnizing true emotions from masked expressions is extremely challenging due to deliberate concealment. Existing paradigms recognize true emotions from masked-expression clips that contain onsetframes just starting to disguise. However, this paradigm may not reflect the actual disguised state, as the onsetframe leaks the true emotional information without reaching a stable disguise state. Thus, this paper introduces a novel apexframe-based paradigm that classifies true emotions from the apexframe with a stable disguised state. Furthermore, this paper proposes a novel dual stream independence decoupling framework that decouples true and disguised emotion features, avoiding the interference of disguised emotions on true emotions. For efficient decoupling, we design a decoupling loss group, comprising two classification losses that learn true emotion and disguised expression features, respectively, and a Hilbert-Schmidt Independence loss that enhances the independence of two features. Experiments demonstrate that the apexframe-based paradigm is challenging, and the proposed decouple framework improves recogntion performances.
format Preprint
id arxiv_https___arxiv_org_abs_2603_16760
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Dual Stream Independence Decoupling for True Emotion Recognition under Masked Expressions
Wei, Jinsheng
Zhang, Xiguang
Shi, Zheng
Lu, Guanming
Computer Vision and Pattern Recognition
Recongnizing true emotions from masked expressions is extremely challenging due to deliberate concealment. Existing paradigms recognize true emotions from masked-expression clips that contain onsetframes just starting to disguise. However, this paradigm may not reflect the actual disguised state, as the onsetframe leaks the true emotional information without reaching a stable disguise state. Thus, this paper introduces a novel apexframe-based paradigm that classifies true emotions from the apexframe with a stable disguised state. Furthermore, this paper proposes a novel dual stream independence decoupling framework that decouples true and disguised emotion features, avoiding the interference of disguised emotions on true emotions. For efficient decoupling, we design a decoupling loss group, comprising two classification losses that learn true emotion and disguised expression features, respectively, and a Hilbert-Schmidt Independence loss that enhances the independence of two features. Experiments demonstrate that the apexframe-based paradigm is challenging, and the proposed decouple framework improves recogntion performances.
title Dual Stream Independence Decoupling for True Emotion Recognition under Masked Expressions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.16760