Multi-task Learning For Joint Action and Gesture Recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Spathis, Konstantinos, Kardaris, Nikolaos, Maragos, Petros
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912389627117568
author Spathis, Konstantinos
Kardaris, Nikolaos
Maragos, Petros
author_facet Spathis, Konstantinos
Kardaris, Nikolaos
Maragos, Petros
contents In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency and improving generalization. Although action and gesture recognition are closely related tasks, since they focus on body and hand movements, current state-of-the-art methods handle them separately. In this paper, we show that employing a multi-task learning paradigm for action and gesture recognition results in more efficient, robust and generalizable visual representations, by leveraging the synergies between these tasks. Extensive experiments on multiple action and gesture datasets demonstrate that handling actions and gestures in a single architecture can achieve better performance for both tasks in comparison to their single-task learning variants.
format Preprint
id arxiv_https___arxiv_org_abs_2505_17867
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-task Learning For Joint Action and Gesture Recognition
Spathis, Konstantinos
Kardaris, Nikolaos
Maragos, Petros
Computer Vision and Pattern Recognition
In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency and improving generalization. Although action and gesture recognition are closely related tasks, since they focus on body and hand movements, current state-of-the-art methods handle them separately. In this paper, we show that employing a multi-task learning paradigm for action and gesture recognition results in more efficient, robust and generalizable visual representations, by leveraging the synergies between these tasks. Extensive experiments on multiple action and gesture datasets demonstrate that handling actions and gestures in a single architecture can achieve better performance for both tasks in comparison to their single-task learning variants.
title Multi-task Learning For Joint Action and Gesture Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.17867