GesturePrint: Enabling User Identification for mmWave-based Gesture Recognition Systems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Lilin, Wang, Keyi, Gu, Chaojie, Guo, Xiuzhen, He, Shibo, Chen, Jiming
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911983718105088
author Xu, Lilin
Wang, Keyi
Gu, Chaojie
Guo, Xiuzhen
He, Shibo
Chen, Jiming
author_facet Xu, Lilin
Wang, Keyi
Gu, Chaojie
Guo, Xiuzhen
He, Shibo
Chen, Jiming
contents The millimeter-wave (mmWave) radar has been exploited for gesture recognition. However, existing mmWave-based gesture recognition methods cannot identify different users, which is important for ubiquitous gesture interaction in many applications. In this paper, we propose GesturePrint, which is the first to achieve gesture recognition and gesture-based user identification using a commodity mmWave radar sensor. GesturePrint features an effective pipeline that enables the gesture recognition system to identify users at a minor additional cost. By introducing an efficient signal preprocessing stage and a network architecture GesIDNet, which employs an attention-based multilevel feature fusion mechanism, GesturePrint effectively extracts unique gesture features for gesture recognition and personalized motion pattern features for user identification. We implement GesturePrint and collect data from 17 participants performing 15 gestures in a meeting room and an office, respectively. GesturePrint achieves a gesture recognition accuracy (GRA) of 98.87% with a user identification accuracy (UIA) of 99.78% in the meeting room, and 98.22% GRA with 99.26% UIA in the office. Extensive experiments on three public datasets and a new gesture dataset show GesturePrint's superior performance in enabling effective user identification for gesture recognition systems.
format Preprint
id arxiv_https___arxiv_org_abs_2408_05358
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle GesturePrint: Enabling User Identification for mmWave-based Gesture Recognition Systems
Xu, Lilin
Wang, Keyi
Gu, Chaojie
Guo, Xiuzhen
He, Shibo
Chen, Jiming
Signal Processing
Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
The millimeter-wave (mmWave) radar has been exploited for gesture recognition. However, existing mmWave-based gesture recognition methods cannot identify different users, which is important for ubiquitous gesture interaction in many applications. In this paper, we propose GesturePrint, which is the first to achieve gesture recognition and gesture-based user identification using a commodity mmWave radar sensor. GesturePrint features an effective pipeline that enables the gesture recognition system to identify users at a minor additional cost. By introducing an efficient signal preprocessing stage and a network architecture GesIDNet, which employs an attention-based multilevel feature fusion mechanism, GesturePrint effectively extracts unique gesture features for gesture recognition and personalized motion pattern features for user identification. We implement GesturePrint and collect data from 17 participants performing 15 gestures in a meeting room and an office, respectively. GesturePrint achieves a gesture recognition accuracy (GRA) of 98.87% with a user identification accuracy (UIA) of 99.78% in the meeting room, and 98.22% GRA with 99.26% UIA in the office. Extensive experiments on three public datasets and a new gesture dataset show GesturePrint's superior performance in enabling effective user identification for gesture recognition systems.
title GesturePrint: Enabling User Identification for mmWave-based Gesture Recognition Systems
topic Signal Processing
Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2408.05358