Point Cloud Context Analysis for Rehabilitation Grasping Assistance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Steinkamp, Jackson M., Brattain, Laura J., Walsh, Conor J., Howe, Robert D.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912116856848384
author Steinkamp, Jackson M.
Brattain, Laura J.
Walsh, Conor J.
Howe, Robert D.
author_facet Steinkamp, Jackson M.
Brattain, Laura J.
Walsh, Conor J.
Howe, Robert D.
contents Controlling hand exoskeletons for assisting impaired patients in grasping tasks is challenging because it is difficult to infer user intent. We hypothesize that majority of daily grasping tasks fall into a small set of categories or modes which can be inferred through real-time analysis of environmental geometry from 3D point clouds. This paper presents a low-cost, real-time system for semantic image labeling of household scenes with the objective to inform and assist activities of daily living. The system consists of a miniature depth camera, an inertial measurement unit and a microprocessor. It is able to achieve 85% or higher accuracy at classification of predefined modes while processing complex 3D scenes at over 30 frames per second. Within each mode it can detect and localize graspable objects. Grasping points can be correctly estimated on average within 1 cm for simple object geometries. The system has potential applications in robotic-assisted rehabilitation as well as manual task assistance.
format Preprint
id arxiv_https___arxiv_org_abs_2411_08169
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Point Cloud Context Analysis for Rehabilitation Grasping Assistance
Steinkamp, Jackson M.
Brattain, Laura J.
Walsh, Conor J.
Howe, Robert D.
Robotics
Controlling hand exoskeletons for assisting impaired patients in grasping tasks is challenging because it is difficult to infer user intent. We hypothesize that majority of daily grasping tasks fall into a small set of categories or modes which can be inferred through real-time analysis of environmental geometry from 3D point clouds. This paper presents a low-cost, real-time system for semantic image labeling of household scenes with the objective to inform and assist activities of daily living. The system consists of a miniature depth camera, an inertial measurement unit and a microprocessor. It is able to achieve 85% or higher accuracy at classification of predefined modes while processing complex 3D scenes at over 30 frames per second. Within each mode it can detect and localize graspable objects. Grasping points can be correctly estimated on average within 1 cm for simple object geometries. The system has potential applications in robotic-assisted rehabilitation as well as manual task assistance.
title Point Cloud Context Analysis for Rehabilitation Grasping Assistance
topic Robotics
url https://arxiv.org/abs/2411.08169