PointGrasp: Point Cloud-based Grasping for Tendon-driven Soft Robotic Glove Applications

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Hu, Chen, Lyu, Shirui, Rho, Eojin, Kim, Daekyum, Luo, Shan, Gionfrida, Letizia
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910373523750912
author Hu, Chen
Lyu, Shirui
Rho, Eojin
Kim, Daekyum
Luo, Shan
Gionfrida, Letizia
author_facet Hu, Chen
Lyu, Shirui
Rho, Eojin
Kim, Daekyum
Luo, Shan
Gionfrida, Letizia
contents Controlling hand exoskeletons to assist individuals with grasping tasks poses a challenge due to the difficulty in understanding user intentions. We propose that most daily grasping tasks during activities of daily living (ADL) can be deduced by analyzing object geometries (simple and complex) from 3D point clouds. The study introduces PointGrasp, a real-time system designed for identifying household scenes semantically, aiming to support and enhance assistance during ADL for tailored end-to-end grasping tasks. The system comprises an RGB-D camera with an inertial measurement unit and a microprocessor integrated into a tendon-driven soft robotic glove. The RGB-D camera processes 3D scenes at a rate exceeding 30 frames per second. The proposed pipeline demonstrates an average RMSE of 0.8 $\pm$ 0.39 cm for simple and 0.11 $\pm$ 0.06 cm for complex geometries. Within each mode, it identifies and pinpoints reachable objects. This system shows promise in end-to-end vision-driven robotic-assisted rehabilitation manual tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12631
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PointGrasp: Point Cloud-based Grasping for Tendon-driven Soft Robotic Glove Applications
Hu, Chen
Lyu, Shirui
Rho, Eojin
Kim, Daekyum
Luo, Shan
Gionfrida, Letizia
Robotics
Artificial Intelligence
I.2; I.4
Controlling hand exoskeletons to assist individuals with grasping tasks poses a challenge due to the difficulty in understanding user intentions. We propose that most daily grasping tasks during activities of daily living (ADL) can be deduced by analyzing object geometries (simple and complex) from 3D point clouds. The study introduces PointGrasp, a real-time system designed for identifying household scenes semantically, aiming to support and enhance assistance during ADL for tailored end-to-end grasping tasks. The system comprises an RGB-D camera with an inertial measurement unit and a microprocessor integrated into a tendon-driven soft robotic glove. The RGB-D camera processes 3D scenes at a rate exceeding 30 frames per second. The proposed pipeline demonstrates an average RMSE of 0.8 $\pm$ 0.39 cm for simple and 0.11 $\pm$ 0.06 cm for complex geometries. Within each mode, it identifies and pinpoints reachable objects. This system shows promise in end-to-end vision-driven robotic-assisted rehabilitation manual tasks.
title PointGrasp: Point Cloud-based Grasping for Tendon-driven Soft Robotic Glove Applications
topic Robotics
Artificial Intelligence
I.2; I.4
url https://arxiv.org/abs/2403.12631