AcTExplore: Active Tactile Exploration of Unknown Objects

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shahidzadeh, Amir-Hossein, Yoo, Seong Jong, Mantripragada, Pavan, Singh, Chahat Deep, Fermüller, Cornelia, Aloimonos, Yiannis
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909228417941504
author Shahidzadeh, Amir-Hossein
Yoo, Seong Jong
Mantripragada, Pavan
Singh, Chahat Deep
Fermüller, Cornelia
Aloimonos, Yiannis
author_facet Shahidzadeh, Amir-Hossein
Yoo, Seong Jong
Mantripragada, Pavan
Singh, Chahat Deep
Fermüller, Cornelia
Aloimonos, Yiannis
contents Tactile exploration plays a crucial role in understanding object structures for fundamental robotics tasks such as grasping and manipulation. However, efficiently exploring such objects using tactile sensors is challenging, primarily due to the large-scale unknown environments and limited sensing coverage of these sensors. To this end, we present AcTExplore, an active tactile exploration method driven by reinforcement learning for object reconstruction at scales that automatically explores the object surfaces in a limited number of steps. Through sufficient exploration, our algorithm incrementally collects tactile data and reconstructs 3D shapes of the objects as well, which can serve as a representation for higher-level downstream tasks. Our method achieves an average of 95.97% IoU coverage on unseen YCB objects while just being trained on primitive shapes. Project Webpage: https://prg.cs.umd.edu/AcTExplore
format Preprint
id arxiv_https___arxiv_org_abs_2310_08745
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle AcTExplore: Active Tactile Exploration of Unknown Objects
Shahidzadeh, Amir-Hossein
Yoo, Seong Jong
Mantripragada, Pavan
Singh, Chahat Deep
Fermüller, Cornelia
Aloimonos, Yiannis
Robotics
Computer Vision and Pattern Recognition
Tactile exploration plays a crucial role in understanding object structures for fundamental robotics tasks such as grasping and manipulation. However, efficiently exploring such objects using tactile sensors is challenging, primarily due to the large-scale unknown environments and limited sensing coverage of these sensors. To this end, we present AcTExplore, an active tactile exploration method driven by reinforcement learning for object reconstruction at scales that automatically explores the object surfaces in a limited number of steps. Through sufficient exploration, our algorithm incrementally collects tactile data and reconstructs 3D shapes of the objects as well, which can serve as a representation for higher-level downstream tasks. Our method achieves an average of 95.97% IoU coverage on unseen YCB objects while just being trained on primitive shapes. Project Webpage: https://prg.cs.umd.edu/AcTExplore
title AcTExplore: Active Tactile Exploration of Unknown Objects
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2310.08745