Saved in:
Bibliographic Details
Main Authors: Amri, Wadhah Zai El, Kuhlmann, Malte, Navarro-Guerrero, Nicolás
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.08533
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918470313050112
author Amri, Wadhah Zai El
Kuhlmann, Malte
Navarro-Guerrero, Nicolás
author_facet Amri, Wadhah Zai El
Kuhlmann, Malte
Navarro-Guerrero, Nicolás
contents Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility in applications like slip detection and object identification, this sensor is now deprecated, making many valuable datasets obsolete. However, recreating similar datasets with newer sensor technologies is both tedious and time-consuming. Therefore, adapting these existing datasets for use with new setups and modalities is crucial. In response, we introduce ACROSS, a novel framework for translating data between tactile sensors by exploiting sensor deformation information. We demonstrate the approach by translating BioTac signals into the DIGIT sensor. Our framework consists of first converting the input signals into 3D deformation meshes. We then transition from the 3D deformation mesh of one sensor to the mesh of another, and finally convert the generated 3D deformation mesh into the corresponding output space. We demonstrate our approach to the most challenging problem of going from a low-dimensional tactile representation to a high-dimensional one. In particular, we transfer the tactile signals of a BioTac sensor to DIGIT tactile images. Our approach enables the continued use of valuable datasets and data exchange between groups with different setups.
format Preprint
id arxiv_https___arxiv_org_abs_2411_08533
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception
Amri, Wadhah Zai El
Kuhlmann, Malte
Navarro-Guerrero, Nicolás
Robotics
Artificial Intelligence
Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility in applications like slip detection and object identification, this sensor is now deprecated, making many valuable datasets obsolete. However, recreating similar datasets with newer sensor technologies is both tedious and time-consuming. Therefore, adapting these existing datasets for use with new setups and modalities is crucial. In response, we introduce ACROSS, a novel framework for translating data between tactile sensors by exploiting sensor deformation information. We demonstrate the approach by translating BioTac signals into the DIGIT sensor. Our framework consists of first converting the input signals into 3D deformation meshes. We then transition from the 3D deformation mesh of one sensor to the mesh of another, and finally convert the generated 3D deformation mesh into the corresponding output space. We demonstrate our approach to the most challenging problem of going from a low-dimensional tactile representation to a high-dimensional one. In particular, we transfer the tactile signals of a BioTac sensor to DIGIT tactile images. Our approach enables the continued use of valuable datasets and data exchange between groups with different setups.
title ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2411.08533