DIANet: A Phase-Aware Dual-Stream Network for Micro-Expression Recognition via Dynamic Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Khuong, Vu Tram Anh, Nguyen, Luu Tu, Man, Thi Bich Phuong, Le, Thanh Ha, Ngo, Thi Duyen
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915553390624768
author Khuong, Vu Tram Anh
Nguyen, Luu Tu
Man, Thi Bich Phuong
Le, Thanh Ha
Ngo, Thi Duyen
author_facet Khuong, Vu Tram Anh
Nguyen, Luu Tu
Man, Thi Bich Phuong
Le, Thanh Ha
Ngo, Thi Duyen
contents Micro-expressions are brief, involuntary facial movements that typically last less than half a second and often reveal genuine emotions. Accurately recognizing these subtle expressions is critical for applications in psychology, security, and behavioral analysis. However, micro-expression recognition (MER) remains a challenging task due to the subtle and transient nature of facial cues and the limited availability of annotated data. While dynamic image (DI) representations have been introduced to summarize temporal motion into a single frame, conventional DI-based methods often overlook the distinct characteristics of different temporal phases within a micro-expression. To address this issue, this paper proposes a novel dual-stream framework, DIANet, which leverages phase-aware dynamic images - one encoding the onset-to-apex phase and the other capturing the apex-to-offset phase. Each stream is processed by a dedicated convolutional neural network, and a cross-attention fusion module is employed to adaptively integrate features from both streams based on their contextual relevance. Extensive experiments conducted on three benchmark MER datasets (CASME-II, SAMM, and MMEW) demonstrate that the proposed method consistently outperforms conventional single-phase DI-based approaches. The results highlight the importance of modeling temporal phase information explicitly and suggest a promising direction for advancing MER.
format Preprint
id arxiv_https___arxiv_org_abs_2510_12219
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DIANet: A Phase-Aware Dual-Stream Network for Micro-Expression Recognition via Dynamic Images
Khuong, Vu Tram Anh
Nguyen, Luu Tu
Man, Thi Bich Phuong
Le, Thanh Ha
Ngo, Thi Duyen
Computer Vision and Pattern Recognition
Micro-expressions are brief, involuntary facial movements that typically last less than half a second and often reveal genuine emotions. Accurately recognizing these subtle expressions is critical for applications in psychology, security, and behavioral analysis. However, micro-expression recognition (MER) remains a challenging task due to the subtle and transient nature of facial cues and the limited availability of annotated data. While dynamic image (DI) representations have been introduced to summarize temporal motion into a single frame, conventional DI-based methods often overlook the distinct characteristics of different temporal phases within a micro-expression. To address this issue, this paper proposes a novel dual-stream framework, DIANet, which leverages phase-aware dynamic images - one encoding the onset-to-apex phase and the other capturing the apex-to-offset phase. Each stream is processed by a dedicated convolutional neural network, and a cross-attention fusion module is employed to adaptively integrate features from both streams based on their contextual relevance. Extensive experiments conducted on three benchmark MER datasets (CASME-II, SAMM, and MMEW) demonstrate that the proposed method consistently outperforms conventional single-phase DI-based approaches. The results highlight the importance of modeling temporal phase information explicitly and suggest a promising direction for advancing MER.
title DIANet: A Phase-Aware Dual-Stream Network for Micro-Expression Recognition via Dynamic Images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.12219