When do they StOP?: A First Step Towards Automatically Identifying Team Communication in the Operating Room

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Keqi, Schewski, Lilien, Srivastav, Vinkle, Lavanchy, Joël, Mutter, Didier, Beldi, Guido, Keller, Sandra, Padoy, Nicolas
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915149047136256
author Chen, Keqi
Schewski, Lilien
Srivastav, Vinkle
Lavanchy, Joël
Mutter, Didier
Beldi, Guido
Keller, Sandra
Padoy, Nicolas
author_facet Chen, Keqi
Schewski, Lilien
Srivastav, Vinkle
Lavanchy, Joël
Mutter, Didier
Beldi, Guido
Keller, Sandra
Padoy, Nicolas
contents Purpose: Surgical performance depends not only on surgeons' technical skills but also on team communication within and across the different professional groups present during the operation. Therefore, automatically identifying team communication in the OR is crucial for patient safety and advances in the development of computer-assisted surgical workflow analysis and intra-operative support systems. To take the first step, we propose a new task of detecting communication briefings involving all OR team members, i.e. the team Time-out and the StOP?-protocol, by localizing their start and end times in video recordings of surgical operations. Methods: We generate an OR dataset of real surgeries, called Team-OR, with more than one hundred hours of surgical videos captured by the multi-view camera system in the OR. The dataset contains temporal annotations of 33 Time-out and 22 StOP?-protocol activities in total. We then propose a novel group activity detection approach, where we encode both scene context and action features, and use an efficient neural network model to output the results. Results: The experimental results on the Team-OR dataset show that our approach outperforms existing state-of-the-art temporal action detection approaches. It also demonstrates the lack of research on group activities in the OR, proving the significance of our dataset. Conclusion: We investigate the Team Time-Out and the StOP?-protocol in the OR, by presenting the first OR dataset with temporal annotations of group activities protocols, and introducing a novel group activity detection approach that outperforms existing approaches. Code is available at https://github.com/CAMMA-public/Team-OR.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08299
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle When do they StOP?: A First Step Towards Automatically Identifying Team Communication in the Operating Room
Chen, Keqi
Schewski, Lilien
Srivastav, Vinkle
Lavanchy, Joël
Mutter, Didier
Beldi, Guido
Keller, Sandra
Padoy, Nicolas
Computer Vision and Pattern Recognition
Purpose: Surgical performance depends not only on surgeons' technical skills but also on team communication within and across the different professional groups present during the operation. Therefore, automatically identifying team communication in the OR is crucial for patient safety and advances in the development of computer-assisted surgical workflow analysis and intra-operative support systems. To take the first step, we propose a new task of detecting communication briefings involving all OR team members, i.e. the team Time-out and the StOP?-protocol, by localizing their start and end times in video recordings of surgical operations. Methods: We generate an OR dataset of real surgeries, called Team-OR, with more than one hundred hours of surgical videos captured by the multi-view camera system in the OR. The dataset contains temporal annotations of 33 Time-out and 22 StOP?-protocol activities in total. We then propose a novel group activity detection approach, where we encode both scene context and action features, and use an efficient neural network model to output the results. Results: The experimental results on the Team-OR dataset show that our approach outperforms existing state-of-the-art temporal action detection approaches. It also demonstrates the lack of research on group activities in the OR, proving the significance of our dataset. Conclusion: We investigate the Team Time-Out and the StOP?-protocol in the OR, by presenting the first OR dataset with temporal annotations of group activities protocols, and introducing a novel group activity detection approach that outperforms existing approaches. Code is available at https://github.com/CAMMA-public/Team-OR.
title When do they StOP?: A First Step Towards Automatically Identifying Team Communication in the Operating Room
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.08299