OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yin, Jessica, Qi, Haozhi, Wi, Youngsun, Kundu, Sayantan, Lambeta, Mike, Yang, William, Wang, Changhao, Wu, Tingfan, Malik, Jitendra, Hellebrekers, Tess
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911310471495680
author Yin, Jessica
Qi, Haozhi
Wi, Youngsun
Kundu, Sayantan
Lambeta, Mike
Yang, William
Wang, Changhao
Wu, Tingfan
Malik, Jitendra
Hellebrekers, Tess
author_facet Yin, Jessica
Qi, Haozhi
Wi, Youngsun
Kundu, Sayantan
Lambeta, Mike
Yang, William
Wang, Changhao
Wu, Tingfan
Malik, Jitendra
Hellebrekers, Tess
contents Human video demonstrations provide abundant training data for learning robot policies, but video alone cannot capture the rich contact signals critical for mastering manipulation. We introduce OSMO, an open-source wearable tactile glove designed for human-to-robot skill transfer. The glove features 12 three-axis tactile sensors across the fingertips and palm and is designed to be compatible with state-of-the-art hand-tracking methods for in-the-wild data collection. We demonstrate that a robot policy trained exclusively on human demonstrations collected with OSMO, without any real robot data, is capable of executing a challenging contact-rich manipulation task. By equipping both the human and the robot with the same glove, OSMO minimizes the visual and tactile embodiment gap, enabling the transfer of continuous shear and normal force feedback while avoiding the need for image inpainting or other vision-based force inference. On a real-world wiping task requiring sustained contact pressure, our tactile-aware policy achieves a 72% success rate, outperforming vision-only baselines by eliminating contact-related failure modes. We release complete hardware designs, firmware, and assembly instructions to support community adoption.
format Preprint
id arxiv_https___arxiv_org_abs_2512_08920
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer
Yin, Jessica
Qi, Haozhi
Wi, Youngsun
Kundu, Sayantan
Lambeta, Mike
Yang, William
Wang, Changhao
Wu, Tingfan
Malik, Jitendra
Hellebrekers, Tess
Robotics
Machine Learning
Human video demonstrations provide abundant training data for learning robot policies, but video alone cannot capture the rich contact signals critical for mastering manipulation. We introduce OSMO, an open-source wearable tactile glove designed for human-to-robot skill transfer. The glove features 12 three-axis tactile sensors across the fingertips and palm and is designed to be compatible with state-of-the-art hand-tracking methods for in-the-wild data collection. We demonstrate that a robot policy trained exclusively on human demonstrations collected with OSMO, without any real robot data, is capable of executing a challenging contact-rich manipulation task. By equipping both the human and the robot with the same glove, OSMO minimizes the visual and tactile embodiment gap, enabling the transfer of continuous shear and normal force feedback while avoiding the need for image inpainting or other vision-based force inference. On a real-world wiping task requiring sustained contact pressure, our tactile-aware policy achieves a 72% success rate, outperforming vision-only baselines by eliminating contact-related failure modes. We release complete hardware designs, firmware, and assembly instructions to support community adoption.
title OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transfer
topic Robotics
Machine Learning
url https://arxiv.org/abs/2512.08920