Saved in:
Bibliographic Details
Main Authors: Cui, Zejian, Baena, Ferdinando Rodriguez y
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2601.14871
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915743435587584
author Cui, Zejian
Baena, Ferdinando Rodriguez y
author_facet Cui, Zejian
Baena, Ferdinando Rodriguez y
contents In Robot-Assisted Minimally Invasive Surgery (RMIS), accurate tool localization is crucial to ensure patient safety and successful task execution. However, this remains challenging for cable-driven robots, such as the da Vinci robot, because erroneous encoder readings lead to pose estimation errors. In this study, we propose a calibration framework to produce accurate tool localization results through computing the hand-eye transformation matrix on-the-fly. The framework consists of two interrelated algorithms: the feature association block and the hand-eye calibration block, which provide robust correspondences for key points detected on monocular images without pre-training, and offer the versatility to accommodate various surgical scenarios by adopting an array of filter approaches, respectively. To validate its efficacy, we test the framework extensively on publicly available video datasets that feature multiple surgical instruments conducting tasks in both in vitro and ex vivo scenarios, under varying illumination conditions and with different levels of key point measurement accuracy. The results show a significant reduction in tool localization errors under the proposed calibration framework, with accuracies comparable to other state-of-the-art methods while being more time-efficient.
format Preprint
id arxiv_https___arxiv_org_abs_2601_14871
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle On-the-fly hand-eye calibration for the da Vinci surgical robot
Cui, Zejian
Baena, Ferdinando Rodriguez y
Robotics
In Robot-Assisted Minimally Invasive Surgery (RMIS), accurate tool localization is crucial to ensure patient safety and successful task execution. However, this remains challenging for cable-driven robots, such as the da Vinci robot, because erroneous encoder readings lead to pose estimation errors. In this study, we propose a calibration framework to produce accurate tool localization results through computing the hand-eye transformation matrix on-the-fly. The framework consists of two interrelated algorithms: the feature association block and the hand-eye calibration block, which provide robust correspondences for key points detected on monocular images without pre-training, and offer the versatility to accommodate various surgical scenarios by adopting an array of filter approaches, respectively. To validate its efficacy, we test the framework extensively on publicly available video datasets that feature multiple surgical instruments conducting tasks in both in vitro and ex vivo scenarios, under varying illumination conditions and with different levels of key point measurement accuracy. The results show a significant reduction in tool localization errors under the proposed calibration framework, with accuracies comparable to other state-of-the-art methods while being more time-efficient.
title On-the-fly hand-eye calibration for the da Vinci surgical robot
topic Robotics
url https://arxiv.org/abs/2601.14871