Long-Short Term Agents for Pure-Vision Bronchoscopy Robotic Autonomy
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914379634573312 |
|---|---|
| author | Wu, Junyang Luo, Mingyi Xie, Fangfang Zhang, Minghui Zhang, Hanxiao Zhang, Chunxi Wang, Junhao Sun, Jiayuan Gu, Yun Yang, Guang-Zhong |
| author_facet | Wu, Junyang Luo, Mingyi Xie, Fangfang Zhang, Minghui Zhang, Hanxiao Zhang, Chunxi Wang, Junhao Sun, Jiayuan Gu, Yun Yang, Guang-Zhong |
| contents | Accurate intraoperative navigation is essential for robot-assisted endoluminal intervention, but remains difficult because of limited endoscopic field of view and dynamic artifacts. Existing navigation platforms often rely on external localization technologies, such as electromagnetic tracking or shape sensing, which increase hardware complexity and remain vulnerable to intraoperative anatomical mismatch. We present a vision-only autonomy framework that performs long-horizon bronchoscopic navigation using preoperative CT-derived virtual targets and live endoscopic video, without external tracking during navigation. The framework uses hierarchical long-short agents: a short-term reactive agent for continuous low-latency motion control, and a long-term strategic agent for decision support at anatomically ambiguous points. When their recommendations conflict, a world-model critic predicts future visual states for candidate actions and selects the action whose predicted state best matches the target view. We evaluated the system in a high-fidelity airway phantom, three ex vivo porcine lungs, and a live porcine model. The system reached all planned segmental targets in the phantom, maintained 80\% success to the eighth generation ex vivo, and achieved in vivo navigation performance comparable to the expert bronchoscopist. These results support the preclinical feasibility of sensor-free autonomous bronchoscopic navigation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_07909 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Long-Short Term Agents for Pure-Vision Bronchoscopy Robotic Autonomy Wu, Junyang Luo, Mingyi Xie, Fangfang Zhang, Minghui Zhang, Hanxiao Zhang, Chunxi Wang, Junhao Sun, Jiayuan Gu, Yun Yang, Guang-Zhong Robotics Artificial Intelligence Accurate intraoperative navigation is essential for robot-assisted endoluminal intervention, but remains difficult because of limited endoscopic field of view and dynamic artifacts. Existing navigation platforms often rely on external localization technologies, such as electromagnetic tracking or shape sensing, which increase hardware complexity and remain vulnerable to intraoperative anatomical mismatch. We present a vision-only autonomy framework that performs long-horizon bronchoscopic navigation using preoperative CT-derived virtual targets and live endoscopic video, without external tracking during navigation. The framework uses hierarchical long-short agents: a short-term reactive agent for continuous low-latency motion control, and a long-term strategic agent for decision support at anatomically ambiguous points. When their recommendations conflict, a world-model critic predicts future visual states for candidate actions and selects the action whose predicted state best matches the target view. We evaluated the system in a high-fidelity airway phantom, three ex vivo porcine lungs, and a live porcine model. The system reached all planned segmental targets in the phantom, maintained 80\% success to the eighth generation ex vivo, and achieved in vivo navigation performance comparable to the expert bronchoscopist. These results support the preclinical feasibility of sensor-free autonomous bronchoscopic navigation. |
| title | Long-Short Term Agents for Pure-Vision Bronchoscopy Robotic Autonomy |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2603.07909 |