Open-Source Multi-Viewpoint Surgical Telerobotics

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Caccianiga, Guido, Sharon, Yarden, Javot, Bernard, Polikovsky, Senya, Ergün, Gökce, Capobianco, Ivan, Mihaljevic, André L., Deguet, Anton, Kuchenbecker, Katherine J.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915289902350336
author Caccianiga, Guido
Sharon, Yarden
Javot, Bernard
Polikovsky, Senya
Ergün, Gökce
Capobianco, Ivan
Mihaljevic, André L.
Deguet, Anton
Kuchenbecker, Katherine J.
author_facet Caccianiga, Guido
Sharon, Yarden
Javot, Bernard
Polikovsky, Senya
Ergün, Gökce
Capobianco, Ivan
Mihaljevic, André L.
Deguet, Anton
Kuchenbecker, Katherine J.
contents As robots for minimally invasive surgery (MIS) gradually become more accessible and modular, we believe there is a great opportunity to rethink and expand the visualization and control paradigms that have characterized surgical teleoperation since its inception. We conjecture that introducing one or more additional adjustable viewpoints in the abdominal cavity would not only unlock novel visualization and collaboration strategies for surgeons but also substantially boost the robustness of machine perception toward shared autonomy. Immediate advantages include controlling a second viewpoint and teleoperating surgical tools from a different perspective, which would allow collaborating surgeons to adjust their views independently and still maneuver their robotic instruments intuitively. Furthermore, we believe that capturing synchronized multi-view 3D measurements of the patient's anatomy would unlock advanced scene representations. Accurate real-time intraoperative 3D perception will allow algorithmic assistants to directly control one or more robotic instruments and/or robotic cameras. Toward these goals, we are building a synchronized multi-viewpoint, multi-sensor robotic surgery system by integrating high-performance vision components and upgrading the da Vinci Research Kit control logic. This short paper reports a functional summary of our setup and elaborates on its potential impacts in research and future clinical practice. By fully open-sourcing our system, we will enable the research community to reproduce our setup, improve it, and develop powerful algorithms, effectively boosting clinical translation of cutting-edge research.
format Preprint
id arxiv_https___arxiv_org_abs_2505_11142
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Open-Source Multi-Viewpoint Surgical Telerobotics
Caccianiga, Guido
Sharon, Yarden
Javot, Bernard
Polikovsky, Senya
Ergün, Gökce
Capobianco, Ivan
Mihaljevic, André L.
Deguet, Anton
Kuchenbecker, Katherine J.
Robotics
Computer Vision and Pattern Recognition
As robots for minimally invasive surgery (MIS) gradually become more accessible and modular, we believe there is a great opportunity to rethink and expand the visualization and control paradigms that have characterized surgical teleoperation since its inception. We conjecture that introducing one or more additional adjustable viewpoints in the abdominal cavity would not only unlock novel visualization and collaboration strategies for surgeons but also substantially boost the robustness of machine perception toward shared autonomy. Immediate advantages include controlling a second viewpoint and teleoperating surgical tools from a different perspective, which would allow collaborating surgeons to adjust their views independently and still maneuver their robotic instruments intuitively. Furthermore, we believe that capturing synchronized multi-view 3D measurements of the patient's anatomy would unlock advanced scene representations. Accurate real-time intraoperative 3D perception will allow algorithmic assistants to directly control one or more robotic instruments and/or robotic cameras. Toward these goals, we are building a synchronized multi-viewpoint, multi-sensor robotic surgery system by integrating high-performance vision components and upgrading the da Vinci Research Kit control logic. This short paper reports a functional summary of our setup and elaborates on its potential impacts in research and future clinical practice. By fully open-sourcing our system, we will enable the research community to reproduce our setup, improve it, and develop powerful algorithms, effectively boosting clinical translation of cutting-edge research.
title Open-Source Multi-Viewpoint Surgical Telerobotics
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.11142