Tactile Neural De-rendering

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Eyzaguirre, Jose A., Oller, Miquel, Fazeli, Nima
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913512048033792
author Eyzaguirre, Jose A.
Oller, Miquel
Fazeli, Nima
author_facet Eyzaguirre, Jose A.
Oller, Miquel
Fazeli, Nima
contents Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on intricate modeling of sensor mechanics or estimation of contact patches, which can be cumbersome and inherently deterministic. In this work, we introduce Tactile Neural De-rendering, a novel approach that leverages a generative model to reconstruct a local 3D representation of an object based solely on its tactile signature. By rendering the object as though perceived by a virtual camera embedded at the fingertip, our method provides a more intuitive and flexible representation of the tactile data. This 3D reconstruction not only facilitates precise pose estimation but also allows for the quantification of uncertainty, providing a robust framework for tactile-based perception in robotics.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13923
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Tactile Neural De-rendering
Eyzaguirre, Jose A.
Oller, Miquel
Fazeli, Nima
Robotics
Tactile sensing has proven to be an invaluable tool for enhancing robotic perception, particularly in scenarios where visual data is limited or unavailable. However, traditional methods for pose estimation using tactile data often rely on intricate modeling of sensor mechanics or estimation of contact patches, which can be cumbersome and inherently deterministic. In this work, we introduce Tactile Neural De-rendering, a novel approach that leverages a generative model to reconstruct a local 3D representation of an object based solely on its tactile signature. By rendering the object as though perceived by a virtual camera embedded at the fingertip, our method provides a more intuitive and flexible representation of the tactile data. This 3D reconstruction not only facilitates precise pose estimation but also allows for the quantification of uncertainty, providing a robust framework for tactile-based perception in robotics.
title Tactile Neural De-rendering
topic Robotics
url https://arxiv.org/abs/2409.13923