Plug-in for visualizing 3D tool tracking from videos of Minimally Invasive Surgeries

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nema, Shubhangi, Mathur, Abhishek, Vachhani, Leena
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910299931541504
author Nema, Shubhangi
Mathur, Abhishek
Vachhani, Leena
author_facet Nema, Shubhangi
Mathur, Abhishek
Vachhani, Leena
contents This paper tackles instrument tracking and 3D visualization challenges in minimally invasive surgery (MIS), crucial for computer-assisted interventions. Conventional and robot-assisted MIS encounter issues with limited 2D camera projections and minimal hardware integration. The objective is to track and visualize the entire surgical instrument, including shaft and metallic clasper, enabling safe navigation within the surgical environment. The proposed method involves 2D tracking based on segmentation maps, facilitating creation of labeled dataset without extensive ground-truth knowledge. Geometric changes in 2D intervals express motion, and kinematics based algorithms process results into 3D tracking information. Synthesized and experimental results in 2D and 3D motion estimates demonstrate negligible errors, validating the method for labeling and motion tracking of instruments in MIS videos. The conclusion underscores the proposed 2D segmentation technique's simplicity and computational efficiency, emphasizing its potential as direct plug-in for 3D visualization in instrument tracking and MIS practices.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09472
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Plug-in for visualizing 3D tool tracking from videos of Minimally Invasive Surgeries
Nema, Shubhangi
Mathur, Abhishek
Vachhani, Leena
Computer Vision and Pattern Recognition
Systems and Control
Image and Video Processing
This paper tackles instrument tracking and 3D visualization challenges in minimally invasive surgery (MIS), crucial for computer-assisted interventions. Conventional and robot-assisted MIS encounter issues with limited 2D camera projections and minimal hardware integration. The objective is to track and visualize the entire surgical instrument, including shaft and metallic clasper, enabling safe navigation within the surgical environment. The proposed method involves 2D tracking based on segmentation maps, facilitating creation of labeled dataset without extensive ground-truth knowledge. Geometric changes in 2D intervals express motion, and kinematics based algorithms process results into 3D tracking information. Synthesized and experimental results in 2D and 3D motion estimates demonstrate negligible errors, validating the method for labeling and motion tracking of instruments in MIS videos. The conclusion underscores the proposed 2D segmentation technique's simplicity and computational efficiency, emphasizing its potential as direct plug-in for 3D visualization in instrument tracking and MIS practices.
title Plug-in for visualizing 3D tool tracking from videos of Minimally Invasive Surgeries
topic Computer Vision and Pattern Recognition
Systems and Control
Image and Video Processing
url https://arxiv.org/abs/2401.09472