Fine-Grained 3D Facial Reconstruction for Micro-Expressions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sun, Che, Zhang, Xinjie, Gao, Rui, Chen, Xu, Wu, Yuwei, Jia, Yunde
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911495393116160
author Sun, Che
Zhang, Xinjie
Gao, Rui
Chen, Xu
Wu, Yuwei
Jia, Yunde
author_facet Sun, Che
Zhang, Xinjie
Gao, Rui
Chen, Xu
Wu, Yuwei
Jia, Yunde
contents Recent advances in 3D facial expression reconstruction have demonstrated remarkable performance in capturing macro-expressions, yet the reconstruction of micro-expressions remains unexplored. This novel task is particularly challenging due to the subtle, transient, and low-intensity nature of micro-expressions, which complicate the extraction of stable and discriminative features essential for accurate reconstruction. In this paper, we propose a fine-grained micro-expression reconstruction method that integrates a global dynamic feature capturing stable facial motion patterns with a locally-enriched feature incorporating multiple informative cues from 2D motions, facial priors and 3D facial geometry. Specifically, we devise a plug-and-play dynamic-encoded module to extract micro-expression feature for global facial action, allowing it to leverage prior knowledge from abundant macro-expression data to mitigate the scarcity of micro-expression data. Subsequently, a dynamic-guided mesh deformation module is designed for extracting aggregated local features from dense optical flow, sparse landmark cues and facial mesh geometry, which adaptively refines fine-grained facial micro-expression without compromising global 3D geometry. Extensive experiments on micro-expression datasets demonstrate that our method consistently outperforms state-of-the-art methods in both geometric accuracy and perceptual detail.
format Preprint
id arxiv_https___arxiv_org_abs_2603_07043
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Fine-Grained 3D Facial Reconstruction for Micro-Expressions
Sun, Che
Zhang, Xinjie
Gao, Rui
Chen, Xu
Wu, Yuwei
Jia, Yunde
Computer Vision and Pattern Recognition
Recent advances in 3D facial expression reconstruction have demonstrated remarkable performance in capturing macro-expressions, yet the reconstruction of micro-expressions remains unexplored. This novel task is particularly challenging due to the subtle, transient, and low-intensity nature of micro-expressions, which complicate the extraction of stable and discriminative features essential for accurate reconstruction. In this paper, we propose a fine-grained micro-expression reconstruction method that integrates a global dynamic feature capturing stable facial motion patterns with a locally-enriched feature incorporating multiple informative cues from 2D motions, facial priors and 3D facial geometry. Specifically, we devise a plug-and-play dynamic-encoded module to extract micro-expression feature for global facial action, allowing it to leverage prior knowledge from abundant macro-expression data to mitigate the scarcity of micro-expression data. Subsequently, a dynamic-guided mesh deformation module is designed for extracting aggregated local features from dense optical flow, sparse landmark cues and facial mesh geometry, which adaptively refines fine-grained facial micro-expression without compromising global 3D geometry. Extensive experiments on micro-expression datasets demonstrate that our method consistently outperforms state-of-the-art methods in both geometric accuracy and perceptual detail.
title Fine-Grained 3D Facial Reconstruction for Micro-Expressions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.07043