Saved in:
Bibliographic Details
Main Authors: Miguel, Altamirano Cabrera, Oleg, Sautenkov, Jonathan, Tirado, Aleksey, Fedoseev, Pavel, Kopanev, Hiroyuki, Kajimoto, Dzmitry, Tsetserukou
Format: Preprint
Published: 2022
Subjects:
Online Access:https://arxiv.org/abs/2204.03521
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914079781683200
author Miguel, Altamirano Cabrera
Oleg, Sautenkov
Jonathan, Tirado
Aleksey, Fedoseev
Pavel, Kopanev
Hiroyuki, Kajimoto
Dzmitry, Tsetserukou
author_facet Miguel, Altamirano Cabrera
Oleg, Sautenkov
Jonathan, Tirado
Aleksey, Fedoseev
Pavel, Kopanev
Hiroyuki, Kajimoto
Dzmitry, Tsetserukou
contents Telemanipulation of deformable objects requires high precision and dexterity from the users, which can be increased by kinesthetic and tactile feedback. However, the object shape can change dynamically, causing ambiguous perception of its alignment and hence errors in the robot positioning. Therefore, the tilt angle and position classification problem has to be solved to present a clear tactile pattern to the user. This work presents a telemanipulation system for plastic pipettes consisting of a multi-contact haptic device LinkGlide to deliver haptic feedback at the users' palm and two tactile sensors array embedded in the 2-finger Robotiq gripper. We propose a novel approach based on Convolutional Neural Networks (CNN) to detect the tilt and position while grasping deformable objects. The CNN generates a mask based on recognized tilt and position data to render further multi-contact tactile stimuli provided to the user during the telemanipulation. The study has shown that using the CNN algorithm and the preset mask, tilt, and position recognition by users is increased from 9.67% using the direct data to 82.5%.
format Preprint
id arxiv_https___arxiv_org_abs_2204_03521
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle DeepXPalm: Tilt and Position Rendering using Palm-worn Haptic Display and CNN-based Tactile Pattern Recognition
Miguel, Altamirano Cabrera
Oleg, Sautenkov
Jonathan, Tirado
Aleksey, Fedoseev
Pavel, Kopanev
Hiroyuki, Kajimoto
Dzmitry, Tsetserukou
Robotics
Artificial Intelligence
Telemanipulation of deformable objects requires high precision and dexterity from the users, which can be increased by kinesthetic and tactile feedback. However, the object shape can change dynamically, causing ambiguous perception of its alignment and hence errors in the robot positioning. Therefore, the tilt angle and position classification problem has to be solved to present a clear tactile pattern to the user. This work presents a telemanipulation system for plastic pipettes consisting of a multi-contact haptic device LinkGlide to deliver haptic feedback at the users' palm and two tactile sensors array embedded in the 2-finger Robotiq gripper. We propose a novel approach based on Convolutional Neural Networks (CNN) to detect the tilt and position while grasping deformable objects. The CNN generates a mask based on recognized tilt and position data to render further multi-contact tactile stimuli provided to the user during the telemanipulation. The study has shown that using the CNN algorithm and the preset mask, tilt, and position recognition by users is increased from 9.67% using the direct data to 82.5%.
title DeepXPalm: Tilt and Position Rendering using Palm-worn Haptic Display and CNN-based Tactile Pattern Recognition
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2204.03521