Efficient Tactile Perception with Soft Electrical Impedance Tomography and Pre-trained Transformer

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Dong, Huazhi, Liu, Ronald B., Teng, Sihao, Hu, Delin, Peisan, E, Giorgio-Serchi, Francesco, Yang, Yunjie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916954145554432
author Dong, Huazhi
Liu, Ronald B.
Teng, Sihao
Hu, Delin
Peisan
E
Giorgio-Serchi, Francesco
Yang, Yunjie
author_facet Dong, Huazhi
Liu, Ronald B.
Teng, Sihao
Hu, Delin
Peisan
E
Giorgio-Serchi, Francesco
Yang, Yunjie
contents Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance Tomography (EIT) has emerged as a promising approach for large-area, distributed tactile sensing with minimal electrode requirements which can lend itself to addressing complex contact problems in robotics. However, existing EIT-based tactile reconstruction methods often suffer from high computational costs or depend on extensive annotated simulation datasets, hindering its viability in real-world settings. To address this shortcoming, here we propose a Pre-trained Transformer for EIT-based Tactile Reconstruction (PTET), a learning-based framework that bridges the simulation-to-reality gap by leveraging self-supervised pretraining on simulation data and fine-tuning with limited real-world data. In simulations, PTET requires 99.44 percent fewer annotated samples than equivalent state-of-the-art approaches (2,500 vs. 450,000 samples) while achieving reconstruction performance improvements of up to 43.57 percent under identical data conditions. Fine-tuning with real-world data further enables PTET to overcome discrepancies between simulated and experimental datasets, achieving superior reconstruction and detail recovery in practical scenarios. The improved reconstruction accuracy, data efficiency, and robustness in real-world tasks establish it as a scalable and practical solution for tactile sensing systems in robotics, especially for object handling and adaptive grasping under varying pressure conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2506_02824
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient Tactile Perception with Soft Electrical Impedance Tomography and Pre-trained Transformer
Dong, Huazhi
Liu, Ronald B.
Teng, Sihao
Hu, Delin
Peisan
E
Giorgio-Serchi, Francesco
Yang, Yunjie
Robotics
Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance Tomography (EIT) has emerged as a promising approach for large-area, distributed tactile sensing with minimal electrode requirements which can lend itself to addressing complex contact problems in robotics. However, existing EIT-based tactile reconstruction methods often suffer from high computational costs or depend on extensive annotated simulation datasets, hindering its viability in real-world settings. To address this shortcoming, here we propose a Pre-trained Transformer for EIT-based Tactile Reconstruction (PTET), a learning-based framework that bridges the simulation-to-reality gap by leveraging self-supervised pretraining on simulation data and fine-tuning with limited real-world data. In simulations, PTET requires 99.44 percent fewer annotated samples than equivalent state-of-the-art approaches (2,500 vs. 450,000 samples) while achieving reconstruction performance improvements of up to 43.57 percent under identical data conditions. Fine-tuning with real-world data further enables PTET to overcome discrepancies between simulated and experimental datasets, achieving superior reconstruction and detail recovery in practical scenarios. The improved reconstruction accuracy, data efficiency, and robustness in real-world tasks establish it as a scalable and practical solution for tactile sensing systems in robotics, especially for object handling and adaptive grasping under varying pressure conditions.
title Efficient Tactile Perception with Soft Electrical Impedance Tomography and Pre-trained Transformer
topic Robotics
url https://arxiv.org/abs/2506.02824