SurgeMOD: Translating image-space tissue motions into vision-based surgical forces
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915038506254336 |
|---|---|
| author | Reyzabal, Mikel De Iturrate Malas, Dionysios Wang, Shuai Ourselin, Sebastien Liu, Hongbin |
| author_facet | Reyzabal, Mikel De Iturrate Malas, Dionysios Wang, Shuai Ourselin, Sebastien Liu, Hongbin |
| contents | We present a new approach for vision-based force estimation in Minimally Invasive Robotic Surgery based on frequency domain basis of motion of organs derived directly from video. Using internal movements generated by natural processes like breathing or the cardiac cycle, we infer the image-space basis of the motion on the frequency domain. As we are working with this representation, we discretize the problem to a limited amount of low-frequencies to build an image-space mechanical model of the environment. We use this pre-built model to define our force estimation problem as a dynamic constraint problem. We demonstrate that this method can estimate point contact forces reliably for silicone phantom and ex-vivo experiments, matching real readings from a force sensor. In addition, we perform qualitative experiments in which we synthesize coherent force textures from surgical videos over a certain region of interest selected by the user. Our method demonstrates good results for both quantitative and qualitative analysis, providing a good starting point for a purely vision-based method for surgical force estimation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_17707 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SurgeMOD: Translating image-space tissue motions into vision-based surgical forces Reyzabal, Mikel De Iturrate Malas, Dionysios Wang, Shuai Ourselin, Sebastien Liu, Hongbin Computer Vision and Pattern Recognition Robotics We present a new approach for vision-based force estimation in Minimally Invasive Robotic Surgery based on frequency domain basis of motion of organs derived directly from video. Using internal movements generated by natural processes like breathing or the cardiac cycle, we infer the image-space basis of the motion on the frequency domain. As we are working with this representation, we discretize the problem to a limited amount of low-frequencies to build an image-space mechanical model of the environment. We use this pre-built model to define our force estimation problem as a dynamic constraint problem. We demonstrate that this method can estimate point contact forces reliably for silicone phantom and ex-vivo experiments, matching real readings from a force sensor. In addition, we perform qualitative experiments in which we synthesize coherent force textures from surgical videos over a certain region of interest selected by the user. Our method demonstrates good results for both quantitative and qualitative analysis, providing a good starting point for a purely vision-based method for surgical force estimation. |
| title | SurgeMOD: Translating image-space tissue motions into vision-based surgical forces |
| topic | Computer Vision and Pattern Recognition Robotics |
| url | https://arxiv.org/abs/2406.17707 |