Gesture Recognition using MediaPipe and OpenCV

Fuente: Zenodo
Saved in:
Bibliographic Details
Main Author: Tristan Chan
Format: Recurso digital
Published: Zenodo 2025
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866902087440269312
author Tristan Chan
author_facet Tristan Chan
contents <p>In this paper, we try to recreate a simple gesture-recognition model attached to a camera that would then be used to interact with a computer such as clicking and scrolling on websites. In order to do this, we used mediapipe's basic online gesture recognition AI and colab's capture video code in order to capture images that would then be fed into the model to determine the gesture. Determining the gesture was hard for the AI, especially if the lighting or camera angle was off even a tiny bit. A way of interacting with websites has not been made due to the complications of implementing a way to do that. Overall, the model had a somewhat low accuracy that could intervene in interacting with computers that could cause it to do the wrong actions. In the future, better algorithms or data could be used to deal with these limitations.</p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_15617010
institution Zenodo
language
publishDate 2025
publisher Zenodo
record_format zenodo
spellingShingle Gesture Recognition using MediaPipe and OpenCV
Tristan Chan
<p>In this paper, we try to recreate a simple gesture-recognition model attached to a camera that would then be used to interact with a computer such as clicking and scrolling on websites. In order to do this, we used mediapipe's basic online gesture recognition AI and colab's capture video code in order to capture images that would then be fed into the model to determine the gesture. Determining the gesture was hard for the AI, especially if the lighting or camera angle was off even a tiny bit. A way of interacting with websites has not been made due to the complications of implementing a way to do that. Overall, the model had a somewhat low accuracy that could intervene in interacting with computers that could cause it to do the wrong actions. In the future, better algorithms or data could be used to deal with these limitations.</p>
title Gesture Recognition using MediaPipe and OpenCV
url https://doi.org/10.5281/zenodo.15617010