Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysis
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918128498245632 |
|---|---|
| author | Mastropasqua, Nicolas Bugueno-Cordova, Ignacio Verschae, Rodrigo Acevedo, Daniel Negri, Pablo Buemi, Maria E. |
| author_facet | Mastropasqua, Nicolas Bugueno-Cordova, Ignacio Verschae, Rodrigo Acevedo, Daniel Negri, Pablo Buemi, Maria E. |
| contents | Micro-expression analysis has applications in domains such as Human-Robot Interaction and Driver Monitoring Systems. Accurately capturing subtle and fast facial movements remains difficult when relying solely on RGB cameras, due to limitations in temporal resolution and sensitivity to motion blur. Event cameras offer an alternative, with microsecond-level precision, high dynamic range, and low latency. However, public datasets featuring event-based recordings of Action Units are still scarce. In this work, we introduce a novel, preliminary multi-resolution and multi-modal micro-expression dataset recorded with synchronized RGB and event cameras under variable lighting conditions. Two baseline tasks are evaluated to explore the spatial-temporal dynamics of micro-expressions: Action Unit classification using Spiking Neural Networks (51.23\% accuracy with events vs. 23.12\% with RGB), and frame reconstruction using Conditional Variational Autoencoders, achieving SSIM = 0.8513 and PSNR = 26.89 dB with high-resolution event input. These promising results show that event-based data can be used for micro-expression recognition and frame reconstruction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_11988 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysis Mastropasqua, Nicolas Bugueno-Cordova, Ignacio Verschae, Rodrigo Acevedo, Daniel Negri, Pablo Buemi, Maria E. Computer Vision and Pattern Recognition Micro-expression analysis has applications in domains such as Human-Robot Interaction and Driver Monitoring Systems. Accurately capturing subtle and fast facial movements remains difficult when relying solely on RGB cameras, due to limitations in temporal resolution and sensitivity to motion blur. Event cameras offer an alternative, with microsecond-level precision, high dynamic range, and low latency. However, public datasets featuring event-based recordings of Action Units are still scarce. In this work, we introduce a novel, preliminary multi-resolution and multi-modal micro-expression dataset recorded with synchronized RGB and event cameras under variable lighting conditions. Two baseline tasks are evaluated to explore the spatial-temporal dynamics of micro-expressions: Action Unit classification using Spiking Neural Networks (51.23\% accuracy with events vs. 23.12\% with RGB), and frame reconstruction using Conditional Variational Autoencoders, achieving SSIM = 0.8513 and PSNR = 26.89 dB with high-resolution event input. These promising results show that event-based data can be used for micro-expression recognition and frame reconstruction. |
| title | Exploring Spatial-Temporal Dynamics in Event-based Facial Micro-Expression Analysis |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.11988 |