Neuromorphic Valence and Arousal Estimation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916109212450816 |
|---|---|
| author | Berlincioni, Lorenzo Cultrera, Luca Becattini, Federico Del Bimbo, Alberto |
| author_facet | Berlincioni, Lorenzo Cultrera, Luca Becattini, Federico Del Bimbo, Alberto |
| contents | Recognizing faces and their underlying emotions is an important aspect of biometrics. In fact, estimating emotional states from faces has been tackled from several angles in the literature. In this paper, we follow the novel route of using neuromorphic data to predict valence and arousal values from faces. Due to the difficulty of gathering event-based annotated videos, we leverage an event camera simulator to create the neuromorphic counterpart of an existing RGB dataset. We demonstrate that not only training models on simulated data can still yield state-of-the-art results in valence-arousal estimation, but also that our trained models can be directly applied to real data without further training to address the downstream task of emotion recognition. In the paper we propose several alternative models to solve the task, both frame-based and video-based. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_16058 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Neuromorphic Valence and Arousal Estimation Berlincioni, Lorenzo Cultrera, Luca Becattini, Federico Del Bimbo, Alberto Computer Vision and Pattern Recognition Recognizing faces and their underlying emotions is an important aspect of biometrics. In fact, estimating emotional states from faces has been tackled from several angles in the literature. In this paper, we follow the novel route of using neuromorphic data to predict valence and arousal values from faces. Due to the difficulty of gathering event-based annotated videos, we leverage an event camera simulator to create the neuromorphic counterpart of an existing RGB dataset. We demonstrate that not only training models on simulated data can still yield state-of-the-art results in valence-arousal estimation, but also that our trained models can be directly applied to real data without further training to address the downstream task of emotion recognition. In the paper we propose several alternative models to solve the task, both frame-based and video-based. |
| title | Neuromorphic Valence and Arousal Estimation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.16058 |