Saved in:
Bibliographic Details
Main Authors: Wang, Kailing, Yang, Chen, Wang, Yuehao, Li, Sikuang, Wang, Yan, Dou, Qi, Yang, Xiaokang, Shen, Wei
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.15124
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914724790140928
author Wang, Kailing
Yang, Chen
Wang, Yuehao
Li, Sikuang
Wang, Yan
Dou, Qi
Yang, Xiaokang
Shen, Wei
author_facet Wang, Kailing
Yang, Chen
Wang, Yuehao
Li, Sikuang
Wang, Yan
Dou, Qi
Yang, Xiaokang
Shen, Wei
contents Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications among endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates streamlined Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://EndoGSLAM.loping151.com
format Preprint
id arxiv_https___arxiv_org_abs_2403_15124
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting
Wang, Kailing
Yang, Chen
Wang, Yuehao
Li, Sikuang
Wang, Yan
Dou, Qi
Yang, Xiaokang
Shen, Wei
Computer Vision and Pattern Recognition
Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization and Mapping) methods often struggle to achieve both complete high-quality surgical field reconstruction and efficient computation, restricting their intraoperative applications among endoscopic surgeries. In this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic surgeries, which integrates streamlined Gaussian representation and differentiable rasterization to facilitate over 100 fps rendering speed during online camera tracking and tissue reconstructing. Extensive experiments show that EndoGSLAM achieves a better trade-off between intraoperative availability and reconstruction quality than traditional or neural SLAM approaches, showing tremendous potential for endoscopic surgeries. The project page is at https://EndoGSLAM.loping151.com
title EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic Surgeries using Gaussian Splatting
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.15124