TEXterity: Tactile Extrinsic deXterity

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Bronars, Antonia, Kim, Sangwoon, Patre, Parag, Rodriguez, Alberto
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913201989353472
author Bronars, Antonia
Kim, Sangwoon
Patre, Parag
Rodriguez, Alberto
author_facet Bronars, Antonia
Kim, Sangwoon
Patre, Parag
Rodriguez, Alberto
contents We introduce a novel approach that combines tactile estimation and control for in-hand object manipulation. By integrating measurements from robot kinematics and an image-based tactile sensor, our framework estimates and tracks object pose while simultaneously generating motion plans to control the pose of a grasped object. This approach consists of a discrete pose estimator that uses the Viterbi decoding algorithm to find the most likely sequence of object poses in a coarsely discretized grid, and a continuous pose estimator-controller to refine the pose estimate and accurately manipulate the pose of the grasped object. Our method is tested on diverse objects and configurations, achieving desired manipulation objectives and outperforming single-shot methods in estimation accuracy. The proposed approach holds potential for tasks requiring precise manipulation in scenarios where visual perception is limited, laying the foundation for closed-loop behavior applications such as assembly and tool use. Please see supplementary videos for real-world demonstration at https://sites.google.com/view/texterity.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10230
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TEXterity: Tactile Extrinsic deXterity
Bronars, Antonia
Kim, Sangwoon
Patre, Parag
Rodriguez, Alberto
Robotics
We introduce a novel approach that combines tactile estimation and control for in-hand object manipulation. By integrating measurements from robot kinematics and an image-based tactile sensor, our framework estimates and tracks object pose while simultaneously generating motion plans to control the pose of a grasped object. This approach consists of a discrete pose estimator that uses the Viterbi decoding algorithm to find the most likely sequence of object poses in a coarsely discretized grid, and a continuous pose estimator-controller to refine the pose estimate and accurately manipulate the pose of the grasped object. Our method is tested on diverse objects and configurations, achieving desired manipulation objectives and outperforming single-shot methods in estimation accuracy. The proposed approach holds potential for tasks requiring precise manipulation in scenarios where visual perception is limited, laying the foundation for closed-loop behavior applications such as assembly and tool use. Please see supplementary videos for real-world demonstration at https://sites.google.com/view/texterity.
title TEXterity: Tactile Extrinsic deXterity
topic Robotics
url https://arxiv.org/abs/2401.10230