Robotic Calibration Based on Haptic Feedback Improves Sim-to-Real Transfer

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gavura, Juraj, Vavrecka, Michal, Farkas, Igor, Gade, Connor
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909685092712448
author Gavura, Juraj
Vavrecka, Michal
Farkas, Igor
Gade, Connor
author_facet Gavura, Juraj
Vavrecka, Michal
Farkas, Igor
Gade, Connor
contents When inverse kinematics (IK) is adopted to control robotic arms in manipulation tasks, there is often a discrepancy between the end effector (EE) position of the robot model in the simulator and the physical EE in reality. In most robotic scenarios with sim-to-real transfer, we have information about joint positions in both simulation and reality, but the EE position is only available in simulation. We developed a novel method to overcome this difficulty based on haptic feedback calibration, using a touchscreen in front of the robot that provides information on the EE position in the real environment. During the calibration procedure, the robot touches specific points on the screen, and the information is stored. In the next stage, we build a transformation function from the data based on linear transformation and neural networks that is capable of outputting all missing variables from any partial input (simulated/real joint/EE position). Our results demonstrate that a fully nonlinear neural network model performs best, significantly reducing positioning errors.
format Preprint
id arxiv_https___arxiv_org_abs_2507_08572
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robotic Calibration Based on Haptic Feedback Improves Sim-to-Real Transfer
Gavura, Juraj
Vavrecka, Michal
Farkas, Igor
Gade, Connor
Robotics
When inverse kinematics (IK) is adopted to control robotic arms in manipulation tasks, there is often a discrepancy between the end effector (EE) position of the robot model in the simulator and the physical EE in reality. In most robotic scenarios with sim-to-real transfer, we have information about joint positions in both simulation and reality, but the EE position is only available in simulation. We developed a novel method to overcome this difficulty based on haptic feedback calibration, using a touchscreen in front of the robot that provides information on the EE position in the real environment. During the calibration procedure, the robot touches specific points on the screen, and the information is stored. In the next stage, we build a transformation function from the data based on linear transformation and neural networks that is capable of outputting all missing variables from any partial input (simulated/real joint/EE position). Our results demonstrate that a fully nonlinear neural network model performs best, significantly reducing positioning errors.
title Robotic Calibration Based on Haptic Feedback Improves Sim-to-Real Transfer
topic Robotics
url https://arxiv.org/abs/2507.08572