EndoSERV: A Vision-based Endoluminal Robot Navigation System

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Junyang, Xie, Fangfang, Zhang, Minghui, Zhang, Hanxiao, Sun, Jiayuan, Gu, Yun, Yang, Guang-Zhong
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910046357553152
author Wu, Junyang
Xie, Fangfang
Zhang, Minghui
Zhang, Hanxiao
Sun, Jiayuan
Gu, Yun
Yang, Guang-Zhong
author_facet Wu, Junyang
Xie, Fangfang
Zhang, Minghui
Zhang, Hanxiao
Sun, Jiayuan
Gu, Yun
Yang, Guang-Zhong
contents Robot-assisted endoluminal procedures are increasingly used for early cancer intervention. However, the intricate, narrow and tortuous pathways within the luminal anatomy pose substantial difficulties for robot navigation. Vision-based navigation offers a promising solution, but existing localization approaches are error-prone due to tissue deformation, in vivo artifacts and a lack of distinctive landmarks for consistent localization. This paper presents a novel EndoSERV localization method to address these challenges. It includes two main parts, \textit{i.e.}, \textbf{SE}gment-to-structure and \textbf{R}eal-to-\textbf{V}irtual mapping, and hence the name. For long-range and complex luminal structures, we divide them into smaller sub-segments and estimate the odometry independently. To cater for label insufficiency, an efficient transfer technique maps real image features to the virtual domain to use virtual pose ground truth. The training phases of EndoSERV include an offline pretraining to extract texture-agnostic features, and an online phase that adapts to real-world conditions. Extensive experiments based on both public and clinical datasets have been performed to demonstrate the effectiveness of the method even without any real pose labels.
format Preprint
id arxiv_https___arxiv_org_abs_2603_08324
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EndoSERV: A Vision-based Endoluminal Robot Navigation System
Wu, Junyang
Xie, Fangfang
Zhang, Minghui
Zhang, Hanxiao
Sun, Jiayuan
Gu, Yun
Yang, Guang-Zhong
Robotics
Artificial Intelligence
Robot-assisted endoluminal procedures are increasingly used for early cancer intervention. However, the intricate, narrow and tortuous pathways within the luminal anatomy pose substantial difficulties for robot navigation. Vision-based navigation offers a promising solution, but existing localization approaches are error-prone due to tissue deformation, in vivo artifacts and a lack of distinctive landmarks for consistent localization. This paper presents a novel EndoSERV localization method to address these challenges. It includes two main parts, \textit{i.e.}, \textbf{SE}gment-to-structure and \textbf{R}eal-to-\textbf{V}irtual mapping, and hence the name. For long-range and complex luminal structures, we divide them into smaller sub-segments and estimate the odometry independently. To cater for label insufficiency, an efficient transfer technique maps real image features to the virtual domain to use virtual pose ground truth. The training phases of EndoSERV include an offline pretraining to extract texture-agnostic features, and an online phase that adapts to real-world conditions. Extensive experiments based on both public and clinical datasets have been performed to demonstrate the effectiveness of the method even without any real pose labels.
title EndoSERV: A Vision-based Endoluminal Robot Navigation System
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2603.08324