HaGRID - HAnd Gesture Recognition Image Dataset

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kapitanov, Alexander, Kvanchiani, Karina, Nagaev, Alexander, Kraynov, Roman, Makhliarchuk, Andrei
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909340424732672
author Kapitanov, Alexander
Kvanchiani, Karina
Nagaev, Alexander
Kraynov, Roman
Makhliarchuk, Andrei
author_facet Kapitanov, Alexander
Kvanchiani, Karina
Nagaev, Alexander
Kraynov, Roman
Makhliarchuk, Andrei
contents This paper introduces an enormous dataset, HaGRID (HAnd Gesture Recognition Image Dataset), to build a hand gesture recognition (HGR) system concentrating on interaction with devices to manage them. That is why all 18 chosen gestures are endowed with the semiotic function and can be interpreted as a specific action. Although the gestures are static, they were picked up, especially for the ability to design several dynamic gestures. It allows the trained model to recognize not only static gestures such as "like" and "stop" but also "swipes" and "drag and drop" dynamic gestures. The HaGRID contains 554,800 images and bounding box annotations with gesture labels to solve hand detection and gesture classification tasks. The low variability in context and subjects of other datasets was the reason for creating the dataset without such limitations. Utilizing crowdsourcing platforms allowed us to collect samples recorded by 37,583 subjects in at least as many scenes with subject-to-camera distances from 0.5 to 4 meters in various natural light conditions. The influence of the diversity characteristics was assessed in ablation study experiments. Also, we demonstrate the HaGRID ability to be used for pretraining models in HGR tasks. The HaGRID and pretrained models are publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2206_08219
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle HaGRID - HAnd Gesture Recognition Image Dataset
Kapitanov, Alexander
Kvanchiani, Karina
Nagaev, Alexander
Kraynov, Roman
Makhliarchuk, Andrei
Computer Vision and Pattern Recognition
This paper introduces an enormous dataset, HaGRID (HAnd Gesture Recognition Image Dataset), to build a hand gesture recognition (HGR) system concentrating on interaction with devices to manage them. That is why all 18 chosen gestures are endowed with the semiotic function and can be interpreted as a specific action. Although the gestures are static, they were picked up, especially for the ability to design several dynamic gestures. It allows the trained model to recognize not only static gestures such as "like" and "stop" but also "swipes" and "drag and drop" dynamic gestures. The HaGRID contains 554,800 images and bounding box annotations with gesture labels to solve hand detection and gesture classification tasks. The low variability in context and subjects of other datasets was the reason for creating the dataset without such limitations. Utilizing crowdsourcing platforms allowed us to collect samples recorded by 37,583 subjects in at least as many scenes with subject-to-camera distances from 0.5 to 4 meters in various natural light conditions. The influence of the diversity characteristics was assessed in ablation study experiments. Also, we demonstrate the HaGRID ability to be used for pretraining models in HGR tasks. The HaGRID and pretrained models are publicly available.
title HaGRID - HAnd Gesture Recognition Image Dataset
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2206.08219