Forearm Ultrasound based Gesture Recognition on Edge

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bimbraw, Keshav, Zhang, Haichong K., Islam, Bashima
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910605156286464
author Bimbraw, Keshav
Zhang, Haichong K.
Islam, Bashima
author_facet Bimbraw, Keshav
Zhang, Haichong K.
Islam, Bashima
contents Ultrasound imaging of the forearm has demonstrated significant potential for accurate hand gesture classification. Despite this progress, there has been limited focus on developing a stand-alone end- to-end gesture recognition system which makes it mobile, real-time and more user friendly. To bridge this gap, this paper explores the deployment of deep neural networks for forearm ultrasound-based hand gesture recognition on edge devices. Utilizing quantization techniques, we achieve substantial reductions in model size while maintaining high accuracy and low latency. Our best model, with Float16 quantization, achieves a test accuracy of 92% and an inference time of 0.31 seconds on a Raspberry Pi. These results demonstrate the feasibility of efficient, real-time gesture recognition on resource-limited edge devices, paving the way for wearable ultrasound-based systems.
format Preprint
id arxiv_https___arxiv_org_abs_2409_09915
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Forearm Ultrasound based Gesture Recognition on Edge
Bimbraw, Keshav
Zhang, Haichong K.
Islam, Bashima
Computer Vision and Pattern Recognition
Robotics
Ultrasound imaging of the forearm has demonstrated significant potential for accurate hand gesture classification. Despite this progress, there has been limited focus on developing a stand-alone end- to-end gesture recognition system which makes it mobile, real-time and more user friendly. To bridge this gap, this paper explores the deployment of deep neural networks for forearm ultrasound-based hand gesture recognition on edge devices. Utilizing quantization techniques, we achieve substantial reductions in model size while maintaining high accuracy and low latency. Our best model, with Float16 quantization, achieves a test accuracy of 92% and an inference time of 0.31 seconds on a Raspberry Pi. These results demonstrate the feasibility of efficient, real-time gesture recognition on resource-limited edge devices, paving the way for wearable ultrasound-based systems.
title Forearm Ultrasound based Gesture Recognition on Edge
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2409.09915