Saved in:
Bibliographic Details
Main Authors: Malayeri, Ali Bahari, Seibold, Matthias, Cavalcanti, Nicola, Hein, Jonas, Jecklin, Sascha, Vlachopoulos, Lazaros, Fucentese, Sandro, Hodel, Sandro, Furnstahl, Philipp
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.07431
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912506347257856
author Malayeri, Ali Bahari
Seibold, Matthias
Cavalcanti, Nicola
Hein, Jonas
Jecklin, Sascha
Vlachopoulos, Lazaros
Fucentese, Sandro
Hodel, Sandro
Furnstahl, Philipp
author_facet Malayeri, Ali Bahari
Seibold, Matthias
Cavalcanti, Nicola
Hein, Jonas
Jecklin, Sascha
Vlachopoulos, Lazaros
Fucentese, Sandro
Hodel, Sandro
Furnstahl, Philipp
contents This study aims to advance surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and developing a novel transformer-based model. We aim to establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address the specific challenges of arthroscopic videos including limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through a ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.91% on the ACL27 dataset. On the Cholec80 dataset, the model achieved a comparable performance with the state-of-the-art methods with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.86% on ACL27 and Cholec80 datasets respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and a robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research and development in this critical field.
format Preprint
id arxiv_https___arxiv_org_abs_2502_07431
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ArthroPhase: A Novel Dataset and Method for Phase Recognition in Arthroscopic Video
Malayeri, Ali Bahari
Seibold, Matthias
Cavalcanti, Nicola
Hein, Jonas
Jecklin, Sascha
Vlachopoulos, Lazaros
Fucentese, Sandro
Hodel, Sandro
Furnstahl, Philipp
Computer Vision and Pattern Recognition
This study aims to advance surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and developing a novel transformer-based model. We aim to establish a benchmark for arthroscopic surgical phase recognition by leveraging spatio-temporal features to address the specific challenges of arthroscopic videos including limited field of view, occlusions, and visual distortions. We developed the ACL27 dataset, comprising 27 videos of ACL surgeries, each labeled with surgical phases. Our model employs a transformer-based architecture, utilizing temporal-aware frame-wise feature extraction through a ResNet-50 and transformer layers. This approach integrates spatio-temporal features and introduces a Surgical Progress Index (SPI) to quantify surgery progression. The model's performance was evaluated using accuracy, precision, recall, and Jaccard Index on the ACL27 and Cholec80 datasets. The proposed model achieved an overall accuracy of 72.91% on the ACL27 dataset. On the Cholec80 dataset, the model achieved a comparable performance with the state-of-the-art methods with an accuracy of 92.4%. The SPI demonstrated an output error of 10.6% and 9.86% on ACL27 and Cholec80 datasets respectively, indicating reliable surgery progression estimation. This study introduces a significant advancement in surgical phase recognition for arthroscopy, providing a comprehensive dataset and a robust transformer-based model. The results validate the model's effectiveness and generalizability, highlighting its potential to improve surgical training, real-time assistance, and operational efficiency in orthopedic surgery. The publicly available dataset and code will facilitate future research and development in this critical field.
title ArthroPhase: A Novel Dataset and Method for Phase Recognition in Arthroscopic Video
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.07431