UltraTac: Integrated Ultrasound-Augmented Visuotactile Sensor for Enhanced Robotic Perception

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Gong, Junhao, Sou, Kit-Wa, Li, Shoujie, Guo, Changqing, Huang, Yan, Lyu, Chuqiao, Song, Ziwu, Ding, Wenbo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914012934963200
author Gong, Junhao
Sou, Kit-Wa
Li, Shoujie
Guo, Changqing
Huang, Yan
Lyu, Chuqiao
Song, Ziwu
Ding, Wenbo
author_facet Gong, Junhao
Sou, Kit-Wa
Li, Shoujie
Guo, Changqing
Huang, Yan
Lyu, Chuqiao
Song, Ziwu
Ding, Wenbo
contents Visuotactile sensors provide high-resolution tactile information but are incapable of perceiving the material features of objects. We present UltraTac, an integrated sensor that combines visuotactile imaging with ultrasound sensing through a coaxial optoacoustic architecture. The design shares structural components and achieves consistent sensing regions for both modalities. Additionally, we incorporate acoustic matching into the traditional visuotactile sensor structure, enabling integration of the ultrasound sensing modality without compromising visuotactile performance. Through tactile feedback, we dynamically adjust the operating state of the ultrasound module to achieve flexible functional coordination. Systematic experiments demonstrate three key capabilities: proximity sensing in the 3-8 cm range ($R^2=0.90$), material classification (average accuracy: 99.20%), and texture-material dual-mode object recognition achieving 92.11% accuracy on a 15-class task. Finally, we integrate the sensor into a robotic manipulation system to concurrently detect container surface patterns and internal content, which verifies its potential for advanced human-machine interaction and precise robotic manipulation.
format Preprint
id arxiv_https___arxiv_org_abs_2508_20982
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UltraTac: Integrated Ultrasound-Augmented Visuotactile Sensor for Enhanced Robotic Perception
Gong, Junhao
Sou, Kit-Wa
Li, Shoujie
Guo, Changqing
Huang, Yan
Lyu, Chuqiao
Song, Ziwu
Ding, Wenbo
Robotics
Visuotactile sensors provide high-resolution tactile information but are incapable of perceiving the material features of objects. We present UltraTac, an integrated sensor that combines visuotactile imaging with ultrasound sensing through a coaxial optoacoustic architecture. The design shares structural components and achieves consistent sensing regions for both modalities. Additionally, we incorporate acoustic matching into the traditional visuotactile sensor structure, enabling integration of the ultrasound sensing modality without compromising visuotactile performance. Through tactile feedback, we dynamically adjust the operating state of the ultrasound module to achieve flexible functional coordination. Systematic experiments demonstrate three key capabilities: proximity sensing in the 3-8 cm range ($R^2=0.90$), material classification (average accuracy: 99.20%), and texture-material dual-mode object recognition achieving 92.11% accuracy on a 15-class task. Finally, we integrate the sensor into a robotic manipulation system to concurrently detect container surface patterns and internal content, which verifies its potential for advanced human-machine interaction and precise robotic manipulation.
title UltraTac: Integrated Ultrasound-Augmented Visuotactile Sensor for Enhanced Robotic Perception
topic Robotics
url https://arxiv.org/abs/2508.20982