PERSEUS: Perception with Semantic Endoscopic Understanding and SLAM
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911383482793984 |
|---|---|
| author | Acar, Ayberk Li, Fangjie Stern, Susheela Sharma Al-Zogbi, Lidia Li, Hao Oguine, Kanyifeechukwu Jane Isik, Dilara Burkhart, Brendan d'Almeida, Jesse F. Webster III, Robert J. Oguz, Ipek Wu, Jie Ying |
| author_facet | Acar, Ayberk Li, Fangjie Stern, Susheela Sharma Al-Zogbi, Lidia Li, Hao Oguine, Kanyifeechukwu Jane Isik, Dilara Burkhart, Brendan d'Almeida, Jesse F. Webster III, Robert J. Oguz, Ipek Wu, Jie Ying |
| contents | Purpose: Natural orifice surgeries minimize the need for incisions and reduce the recovery time compared to open surgery; however, they require a higher level of expertise due to visualization and orientation challenges. We propose a perception pipeline for these surgeries that allows semantic scene understanding.
Methods: We bring learning-based segmentation, depth estimation, and 3D reconstruction modules together to create real-time segmented maps of the surgical scenes. Additionally, we use registration with robot poses to solve the scale ambiguity of mapping from monocular images, and allow the use of semantically informed real-time reconstructions in robotic surgeries.
Results: We achieve sub-milimeter reconstruction accuracy based on average one-sided Chamfer distances, average pose registration RMSE of 0.9 mm, and an estimated scale within 2% of ground truth.
Conclusion: We present a modular perception pipeline, integrating semantic segmentation with real-time monocular SLAM for natural orifice surgeries. This pipeline offers a promising solution for scene understanding that can facilitate automation or surgeon guidance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_13541 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | PERSEUS: Perception with Semantic Endoscopic Understanding and SLAM Acar, Ayberk Li, Fangjie Stern, Susheela Sharma Al-Zogbi, Lidia Li, Hao Oguine, Kanyifeechukwu Jane Isik, Dilara Burkhart, Brendan d'Almeida, Jesse F. Webster III, Robert J. Oguz, Ipek Wu, Jie Ying Robotics Computer Vision and Pattern Recognition Purpose: Natural orifice surgeries minimize the need for incisions and reduce the recovery time compared to open surgery; however, they require a higher level of expertise due to visualization and orientation challenges. We propose a perception pipeline for these surgeries that allows semantic scene understanding. Methods: We bring learning-based segmentation, depth estimation, and 3D reconstruction modules together to create real-time segmented maps of the surgical scenes. Additionally, we use registration with robot poses to solve the scale ambiguity of mapping from monocular images, and allow the use of semantically informed real-time reconstructions in robotic surgeries. Results: We achieve sub-milimeter reconstruction accuracy based on average one-sided Chamfer distances, average pose registration RMSE of 0.9 mm, and an estimated scale within 2% of ground truth. Conclusion: We present a modular perception pipeline, integrating semantic segmentation with real-time monocular SLAM for natural orifice surgeries. This pipeline offers a promising solution for scene understanding that can facilitate automation or surgeon guidance. |
| title | PERSEUS: Perception with Semantic Endoscopic Understanding and SLAM |
| topic | Robotics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.13541 |