Automated Surgical Skill Assessment in Endoscopic Pituitary Surgery using Real-time Instrument Tracking on a High-fidelity Bench-top Phantom

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Das, Adrito, Sidiqi, Bilal, Mennillo, Laurent, Mao, Zhehua, Brudfors, Mikael, Xochicale, Miguel, Khan, Danyal Z., Newall, Nicola, Hanrahan, John G., Clarkson, Matthew J., Stoyanov, Danail, Marcus, Hani J., Bano, Sophia
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916410956972032
author Das, Adrito
Sidiqi, Bilal
Mennillo, Laurent
Mao, Zhehua
Brudfors, Mikael
Xochicale, Miguel
Khan, Danyal Z.
Newall, Nicola
Hanrahan, John G.
Clarkson, Matthew J.
Stoyanov, Danail
Marcus, Hani J.
Bano, Sophia
author_facet Das, Adrito
Sidiqi, Bilal
Mennillo, Laurent
Mao, Zhehua
Brudfors, Mikael
Xochicale, Miguel
Khan, Danyal Z.
Newall, Nicola
Hanrahan, John G.
Clarkson, Matthew J.
Stoyanov, Danail
Marcus, Hani J.
Bano, Sophia
contents Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as demonstrated by existing machine learning instrument tracking models in minimally invasive surgery. However, these models have been tested on limited datasets of laparoscopic surgery, with a focus on isolated tasks and robotic surgery. In this paper, a new public dataset is introduced, focusing on simulated surgery, using the nasal phase of endoscopic pituitary surgery as an exemplar. Simulated surgery allows for a realistic yet repeatable environment, meaning the insights gained from automated assessment can be used by novice surgeons to hone their skills on the simulator before moving to real surgery. PRINTNet (Pituitary Real-time INstrument Tracking Network) has been created as a baseline model for this automated assessment. Consisting of DeepLabV3 for classification and segmentation; StrongSORT for tracking; and the NVIDIA Holoscan SDK for real-time performance, PRINTNet achieved 71.9% Multiple Object Tracking Precision running at 22 Frames Per Second. Using this tracking output, a Multilayer Perceptron achieved 87% accuracy in predicting surgical skill level (novice or expert), with the "ratio of total procedure time to instrument visible time" correlated with higher surgical skill. This therefore demonstrates the feasibility of automated surgical skill assessment in simulated endoscopic pituitary surgery. The new publicly available dataset can be found here: https://doi.org/10.5522/04/26511049.
format Preprint
id arxiv_https___arxiv_org_abs_2409_17025
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automated Surgical Skill Assessment in Endoscopic Pituitary Surgery using Real-time Instrument Tracking on a High-fidelity Bench-top Phantom
Das, Adrito
Sidiqi, Bilal
Mennillo, Laurent
Mao, Zhehua
Brudfors, Mikael
Xochicale, Miguel
Khan, Danyal Z.
Newall, Nicola
Hanrahan, John G.
Clarkson, Matthew J.
Stoyanov, Danail
Marcus, Hani J.
Bano, Sophia
Image and Video Processing
Computer Vision and Pattern Recognition
Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as demonstrated by existing machine learning instrument tracking models in minimally invasive surgery. However, these models have been tested on limited datasets of laparoscopic surgery, with a focus on isolated tasks and robotic surgery. In this paper, a new public dataset is introduced, focusing on simulated surgery, using the nasal phase of endoscopic pituitary surgery as an exemplar. Simulated surgery allows for a realistic yet repeatable environment, meaning the insights gained from automated assessment can be used by novice surgeons to hone their skills on the simulator before moving to real surgery. PRINTNet (Pituitary Real-time INstrument Tracking Network) has been created as a baseline model for this automated assessment. Consisting of DeepLabV3 for classification and segmentation; StrongSORT for tracking; and the NVIDIA Holoscan SDK for real-time performance, PRINTNet achieved 71.9% Multiple Object Tracking Precision running at 22 Frames Per Second. Using this tracking output, a Multilayer Perceptron achieved 87% accuracy in predicting surgical skill level (novice or expert), with the "ratio of total procedure time to instrument visible time" correlated with higher surgical skill. This therefore demonstrates the feasibility of automated surgical skill assessment in simulated endoscopic pituitary surgery. The new publicly available dataset can be found here: https://doi.org/10.5522/04/26511049.
title Automated Surgical Skill Assessment in Endoscopic Pituitary Surgery using Real-time Instrument Tracking on a High-fidelity Bench-top Phantom
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.17025