ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914807435755520 |
|---|---|
| author | Lima, Maria Luísa Costa, Willams de Lima Martinez, Estefania Talavera Teichrieb, Veronica |
| author_facet | Lima, Maria Luísa Costa, Willams de Lima Martinez, Estefania Talavera Teichrieb, Veronica |
| contents | Emotion recognition is relevant for human behaviour understanding, where facial expression and speech recognition have been widely explored by the computer vision community. Literature in the field of behavioural psychology indicates that gait, described as the way a person walks, is an additional indicator of emotions. In this work, we propose a deep framework for emotion recognition through the analysis of gait. More specifically, our model is composed of a sequence of spatial-temporal Graph Convolutional Networks that produce a robust skeleton-based representation for the task of emotion classification. We evaluate our proposed framework on the E-Gait dataset, composed of a total of 2177 samples. The results obtained represent an improvement of approximately 5% in accuracy compared to the state of the art. In addition, during training we observed a faster convergence of our model compared to the state-of-the-art methodologies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_13903 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos Lima, Maria Luísa Costa, Willams de Lima Martinez, Estefania Talavera Teichrieb, Veronica Computer Vision and Pattern Recognition Emotion recognition is relevant for human behaviour understanding, where facial expression and speech recognition have been widely explored by the computer vision community. Literature in the field of behavioural psychology indicates that gait, described as the way a person walks, is an additional indicator of emotions. In this work, we propose a deep framework for emotion recognition through the analysis of gait. More specifically, our model is composed of a sequence of spatial-temporal Graph Convolutional Networks that produce a robust skeleton-based representation for the task of emotion classification. We evaluate our proposed framework on the E-Gait dataset, composed of a total of 2177 samples. The results obtained represent an improvement of approximately 5% in accuracy compared to the state of the art. In addition, during training we observed a faster convergence of our model compared to the state-of-the-art methodologies. |
| title | ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2405.13903 |