A three-dimensional force estimation method for the cable-driven soft robot based on monocular images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Xiaohan, Bu, Ran, Li, Zhen, Xu, Fan, Wang, Hesheng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910601778823168
author Zhu, Xiaohan
Bu, Ran
Li, Zhen
Xu, Fan
Wang, Hesheng
author_facet Zhu, Xiaohan
Bu, Ran
Li, Zhen
Xu, Fan
Wang, Hesheng
contents Soft manipulators are known for their superiority in coping with high-safety-demanding interaction tasks, e.g., robot-assisted surgeries, elderly caring, etc. Yet the challenges residing in real-time contact feedback have hindered further applications in precise manipulation. This paper proposes an end-to-end network to estimate the 3D contact force of the soft robot, with the aim of enhancing its capabilities in interactive tasks. The presented method features directly utilizing monocular images fused with multidimensional actuation information as the network inputs. This approach simplifies the preprocessing of raw data compared to related studies that utilize 3D shape information for network inputs, consequently reducing configuration reconstruction errors. The unified feature representation module is devised to elevate low-dimensional features from the system's actuation signals to the same level as image features, facilitating smoother integration of multimodal information. The proposed method has been experimentally validated in the soft robot testbed, achieving satisfying accuracy in 3D force estimation (with a mean relative error of 0.84% compared to the best-reported result of 2.2% in the related works).
format Preprint
id arxiv_https___arxiv_org_abs_2409_08033
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A three-dimensional force estimation method for the cable-driven soft robot based on monocular images
Zhu, Xiaohan
Bu, Ran
Li, Zhen
Xu, Fan
Wang, Hesheng
Robotics
Soft manipulators are known for their superiority in coping with high-safety-demanding interaction tasks, e.g., robot-assisted surgeries, elderly caring, etc. Yet the challenges residing in real-time contact feedback have hindered further applications in precise manipulation. This paper proposes an end-to-end network to estimate the 3D contact force of the soft robot, with the aim of enhancing its capabilities in interactive tasks. The presented method features directly utilizing monocular images fused with multidimensional actuation information as the network inputs. This approach simplifies the preprocessing of raw data compared to related studies that utilize 3D shape information for network inputs, consequently reducing configuration reconstruction errors. The unified feature representation module is devised to elevate low-dimensional features from the system's actuation signals to the same level as image features, facilitating smoother integration of multimodal information. The proposed method has been experimentally validated in the soft robot testbed, achieving satisfying accuracy in 3D force estimation (with a mean relative error of 0.84% compared to the best-reported result of 2.2% in the related works).
title A three-dimensional force estimation method for the cable-driven soft robot based on monocular images
topic Robotics
url https://arxiv.org/abs/2409.08033