Privacy-Preserving Operating Room Workflow Analysis using Digital Twins
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915478002204672 |
|---|---|
| author | Perez, Alejandra Zhang, Han Ku, Yu-Chun Seenivasan, Lalithkumar Soberanis, Roger Porras, Jose L. Day, Richard Jopling, Jeff Najjar, Peter Unberath, Mathias |
| author_facet | Perez, Alejandra Zhang, Han Ku, Yu-Chun Seenivasan, Lalithkumar Soberanis, Roger Porras, Jose L. Day, Richard Jopling, Jeff Najjar, Peter Unberath, Mathias |
| contents | The operating room (OR) is a complex environment where optimizing workflows is critical to reduce costs and improve patient outcomes. While computer vision approaches for automatic recognition of perioperative events can identify bottlenecks for OR optimization, privacy concerns limit the use of OR videos for automated event detection. We propose a two-stage pipeline for privacy-preserving OR video analysis and event detection. First, we leverage vision foundation models for depth estimation and semantic segmentation to generate de-identified Digital Twins (DT) of the OR from conventional RGB videos. Second, we employ the SafeOR model, a fused two-stream approach that processes segmentation masks and depth maps for OR event detection. Evaluation on an internal dataset of 38 simulated surgical trials with five event classes shows that our DT-based approach achieves performance on par with -- and sometimes better than -- raw RGB video-based models for OR event detection. Digital Twins enable privacy-preserving OR workflow analysis, facilitating the sharing of de-identified data across institutions and potentially enhancing model generalizability by mitigating domain-specific appearance differences. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_12552 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Privacy-Preserving Operating Room Workflow Analysis using Digital Twins Perez, Alejandra Zhang, Han Ku, Yu-Chun Seenivasan, Lalithkumar Soberanis, Roger Porras, Jose L. Day, Richard Jopling, Jeff Najjar, Peter Unberath, Mathias Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning The operating room (OR) is a complex environment where optimizing workflows is critical to reduce costs and improve patient outcomes. While computer vision approaches for automatic recognition of perioperative events can identify bottlenecks for OR optimization, privacy concerns limit the use of OR videos for automated event detection. We propose a two-stage pipeline for privacy-preserving OR video analysis and event detection. First, we leverage vision foundation models for depth estimation and semantic segmentation to generate de-identified Digital Twins (DT) of the OR from conventional RGB videos. Second, we employ the SafeOR model, a fused two-stream approach that processes segmentation masks and depth maps for OR event detection. Evaluation on an internal dataset of 38 simulated surgical trials with five event classes shows that our DT-based approach achieves performance on par with -- and sometimes better than -- raw RGB video-based models for OR event detection. Digital Twins enable privacy-preserving OR workflow analysis, facilitating the sharing of de-identified data across institutions and potentially enhancing model generalizability by mitigating domain-specific appearance differences. |
| title | Privacy-Preserving Operating Room Workflow Analysis using Digital Twins |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2504.12552 |