Visuo-Tactile Keypoint Correspondences for Object Manipulation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Jeong-Jung, Koh, Doo-Yeol, Kim, Chang-Hyun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914807854137344
author Kim, Jeong-Jung
Koh, Doo-Yeol
Kim, Chang-Hyun
author_facet Kim, Jeong-Jung
Koh, Doo-Yeol
Kim, Chang-Hyun
contents This paper presents a novel manipulation strategy that uses keypoint correspondences extracted from visuo-tactile sensor images to facilitate precise object manipulation. Our approach uses the visuo-tactile feedback to guide the robot's actions for accurate object grasping and placement, eliminating the need for post-grasp adjustments and extensive training. This method provides an improvement in deployment efficiency, addressing the challenges of manipulation tasks in environments where object locations are not predefined. We validate the effectiveness of our strategy through experiments demonstrating the extraction of keypoint correspondences and their application to real-world tasks such as block alignment and gear insertion, which require millimeter-level precision. The results show an average error margin significantly lower than that of traditional vision-based methods, which is sufficient to achieve the target tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14515
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Visuo-Tactile Keypoint Correspondences for Object Manipulation
Kim, Jeong-Jung
Koh, Doo-Yeol
Kim, Chang-Hyun
Robotics
This paper presents a novel manipulation strategy that uses keypoint correspondences extracted from visuo-tactile sensor images to facilitate precise object manipulation. Our approach uses the visuo-tactile feedback to guide the robot's actions for accurate object grasping and placement, eliminating the need for post-grasp adjustments and extensive training. This method provides an improvement in deployment efficiency, addressing the challenges of manipulation tasks in environments where object locations are not predefined. We validate the effectiveness of our strategy through experiments demonstrating the extraction of keypoint correspondences and their application to real-world tasks such as block alignment and gear insertion, which require millimeter-level precision. The results show an average error margin significantly lower than that of traditional vision-based methods, which is sufficient to achieve the target tasks.
title Visuo-Tactile Keypoint Correspondences for Object Manipulation
topic Robotics
url https://arxiv.org/abs/2405.14515