Creating a Digital Twin of Spinal Surgery: A Proof of Concept
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916257013432320 |
|---|---|
| author | Hein, Jonas Giraud, Frédéric Calvet, Lilian Schwarz, Alexander Cavalcanti, Nicola Alessandro Prokudin, Sergey Farshad, Mazda Tang, Siyu Pollefeys, Marc Carrillo, Fabio Fürnstahl, Philipp |
| author_facet | Hein, Jonas Giraud, Frédéric Calvet, Lilian Schwarz, Alexander Cavalcanti, Nicola Alessandro Prokudin, Sergey Farshad, Mazda Tang, Siyu Pollefeys, Marc Carrillo, Fabio Fürnstahl, Philipp |
| contents | Surgery digitalization is the process of creating a virtual replica of real-world surgery, also referred to as a surgical digital twin (SDT). It has significant applications in various fields such as education and training, surgical planning, and automation of surgical tasks. In addition, SDTs are an ideal foundation for machine learning methods, enabling the automatic generation of training data. In this paper, we present a proof of concept (PoC) for surgery digitalization that is applied to an ex-vivo spinal surgery. The proposed digitalization focuses on the acquisition and modelling of the geometry and appearance of the entire surgical scene. We employ five RGB-D cameras for dynamic 3D reconstruction of the surgeon, a high-end camera for 3D reconstruction of the anatomy, an infrared stereo camera for surgical instrument tracking, and a laser scanner for 3D reconstruction of the operating room and data fusion. We justify the proposed methodology, discuss the challenges faced and further extensions of our prototype. While our PoC partially relies on manual data curation, its high quality and great potential motivate the development of automated methods for the creation of SDTs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_16736 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Creating a Digital Twin of Spinal Surgery: A Proof of Concept Hein, Jonas Giraud, Frédéric Calvet, Lilian Schwarz, Alexander Cavalcanti, Nicola Alessandro Prokudin, Sergey Farshad, Mazda Tang, Siyu Pollefeys, Marc Carrillo, Fabio Fürnstahl, Philipp Computer Vision and Pattern Recognition Surgery digitalization is the process of creating a virtual replica of real-world surgery, also referred to as a surgical digital twin (SDT). It has significant applications in various fields such as education and training, surgical planning, and automation of surgical tasks. In addition, SDTs are an ideal foundation for machine learning methods, enabling the automatic generation of training data. In this paper, we present a proof of concept (PoC) for surgery digitalization that is applied to an ex-vivo spinal surgery. The proposed digitalization focuses on the acquisition and modelling of the geometry and appearance of the entire surgical scene. We employ five RGB-D cameras for dynamic 3D reconstruction of the surgeon, a high-end camera for 3D reconstruction of the anatomy, an infrared stereo camera for surgical instrument tracking, and a laser scanner for 3D reconstruction of the operating room and data fusion. We justify the proposed methodology, discuss the challenges faced and further extensions of our prototype. While our PoC partially relies on manual data curation, its high quality and great potential motivate the development of automated methods for the creation of SDTs. |
| title | Creating a Digital Twin of Spinal Surgery: A Proof of Concept |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.16736 |