Proprioceptive State Estimation for Amphibious Tactile Sensing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Ning, Han, Xudong, Zhong, Shuqiao, Zhou, Zhiyuan, Lin, Jian, Dai, Jian S., Wan, Fang, Song, Chaoyang
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929428161888256
author Guo, Ning
Han, Xudong
Zhong, Shuqiao
Zhou, Zhiyuan
Lin, Jian
Dai, Jian S.
Wan, Fang
Song, Chaoyang
author_facet Guo, Ning
Han, Xudong
Zhong, Shuqiao
Zhou, Zhiyuan
Lin, Jian
Dai, Jian S.
Wan, Fang
Song, Chaoyang
contents This paper presents a novel vision-based proprioception approach for a soft robotic finger that can estimate and reconstruct tactile interactions in both terrestrial and aquatic environments. The key to this system lies in the finger's unique metamaterial structure, which facilitates omni-directional passive adaptation during grasping, protecting delicate objects across diverse scenarios. A compact in-finger camera captures high-framerate images of the finger's deformation during contact, extracting crucial tactile data in real-time. We present a volumetric discretized model of the soft finger and use the geometry constraints captured by the camera to find the optimal estimation of the deformed shape. The approach is benchmarked using a motion capture system with sparse markers and a haptic device with dense measurements. Both results show state-of-the-art accuracies, with a median error of 1.96 mm for overall body deformation, corresponding to 2.1% of the finger's length. More importantly, the state estimation is robust in both on-land and underwater environments as we demonstrate its usage for underwater object shape sensing. This combination of passive adaptation and real-time tactile sensing paves the way for amphibious robotic grasping applications.
format Preprint
id arxiv_https___arxiv_org_abs_2312_09863
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Proprioceptive State Estimation for Amphibious Tactile Sensing
Guo, Ning
Han, Xudong
Zhong, Shuqiao
Zhou, Zhiyuan
Lin, Jian
Dai, Jian S.
Wan, Fang
Song, Chaoyang
Robotics
This paper presents a novel vision-based proprioception approach for a soft robotic finger that can estimate and reconstruct tactile interactions in both terrestrial and aquatic environments. The key to this system lies in the finger's unique metamaterial structure, which facilitates omni-directional passive adaptation during grasping, protecting delicate objects across diverse scenarios. A compact in-finger camera captures high-framerate images of the finger's deformation during contact, extracting crucial tactile data in real-time. We present a volumetric discretized model of the soft finger and use the geometry constraints captured by the camera to find the optimal estimation of the deformed shape. The approach is benchmarked using a motion capture system with sparse markers and a haptic device with dense measurements. Both results show state-of-the-art accuracies, with a median error of 1.96 mm for overall body deformation, corresponding to 2.1% of the finger's length. More importantly, the state estimation is robust in both on-land and underwater environments as we demonstrate its usage for underwater object shape sensing. This combination of passive adaptation and real-time tactile sensing paves the way for amphibious robotic grasping applications.
title Proprioceptive State Estimation for Amphibious Tactile Sensing
topic Robotics
url https://arxiv.org/abs/2312.09863