Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mapping

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Schmidt, Adam, Mohareri, Omid, DiMaio, Simon, Salcudean, Septimiu E.
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911789850034176
author Schmidt, Adam
Mohareri, Omid
DiMaio, Simon
Salcudean, Septimiu E.
author_facet Schmidt, Adam
Mohareri, Omid
DiMaio, Simon
Salcudean, Septimiu E.
contents Quantifying performance of methods for tracking and mapping tissue in endoscopic environments is essential for enabling image guidance and automation of medical interventions and surgery. Datasets developed so far either use rigid environments, visible markers, or require annotators to label salient points in videos after collection. These are respectively: not general, visible to algorithms, or costly and error-prone. We introduce a novel labeling methodology along with a dataset that uses said methodology, Surgical Tattoos in Infrared (STIR). STIR has labels that are persistent but invisible to visible spectrum algorithms. This is done by labelling tissue points with IR-fluorescent dye, indocyanine green (ICG), and then collecting visible light video clips. STIR comprises hundreds of stereo video clips in both in-vivo and ex-vivo scenes with start and end points labelled in the IR spectrum. With over 3,000 labelled points, STIR will help to quantify and enable better analysis of tracking and mapping methods. After introducing STIR, we analyze multiple different frame-based tracking methods on STIR using both 3D and 2D endpoint error and accuracy metrics. STIR is available at https://dx.doi.org/10.21227/w8g4-g548
format Preprint
id arxiv_https___arxiv_org_abs_2309_16782
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mapping
Schmidt, Adam
Mohareri, Omid
DiMaio, Simon
Salcudean, Septimiu E.
Computer Vision and Pattern Recognition
Quantifying performance of methods for tracking and mapping tissue in endoscopic environments is essential for enabling image guidance and automation of medical interventions and surgery. Datasets developed so far either use rigid environments, visible markers, or require annotators to label salient points in videos after collection. These are respectively: not general, visible to algorithms, or costly and error-prone. We introduce a novel labeling methodology along with a dataset that uses said methodology, Surgical Tattoos in Infrared (STIR). STIR has labels that are persistent but invisible to visible spectrum algorithms. This is done by labelling tissue points with IR-fluorescent dye, indocyanine green (ICG), and then collecting visible light video clips. STIR comprises hundreds of stereo video clips in both in-vivo and ex-vivo scenes with start and end points labelled in the IR spectrum. With over 3,000 labelled points, STIR will help to quantify and enable better analysis of tracking and mapping methods. After introducing STIR, we analyze multiple different frame-based tracking methods on STIR using both 3D and 2D endpoint error and accuracy metrics. STIR is available at https://dx.doi.org/10.21227/w8g4-g548
title Surgical Tattoos in Infrared: A Dataset for Quantifying Tissue Tracking and Mapping
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2309.16782