Tracking Any Point Methods for Markerless 3D Tissue Tracking in Endoscopic Stereo Images
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918122080960512 |
|---|---|
| author | Reuter, Konrad Guttikonda, Suresh Latus, Sarah Maack, Lennart Betz, Christian Maurer, Tobias Schlaefer, Alexander |
| author_facet | Reuter, Konrad Guttikonda, Suresh Latus, Sarah Maack, Lennart Betz, Christian Maurer, Tobias Schlaefer, Alexander |
| contents | Minimally invasive surgery presents challenges such as dynamic tissue motion and a limited field of view. Accurate tissue tracking has the potential to support surgical guidance, improve safety by helping avoid damage to sensitive structures, and enable context-aware robotic assistance during complex procedures. In this work, we propose a novel method for markerless 3D tissue tracking by leveraging 2D Tracking Any Point (TAP) networks. Our method combines two CoTracker models, one for temporal tracking and one for stereo matching, to estimate 3D motion from stereo endoscopic images. We evaluate the system using a clinical laparoscopic setup and a robotic arm simulating tissue motion, with experiments conducted on a synthetic 3D-printed phantom and a chicken tissue phantom. Tracking on the chicken tissue phantom yielded more reliable results, with Euclidean distance errors as low as 1.1 mm at a velocity of 10 mm/s. These findings highlight the potential of TAP-based models for accurate, markerless 3D tracking in challenging surgical scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_07851 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Tracking Any Point Methods for Markerless 3D Tissue Tracking in Endoscopic Stereo Images Reuter, Konrad Guttikonda, Suresh Latus, Sarah Maack, Lennart Betz, Christian Maurer, Tobias Schlaefer, Alexander Computer Vision and Pattern Recognition Minimally invasive surgery presents challenges such as dynamic tissue motion and a limited field of view. Accurate tissue tracking has the potential to support surgical guidance, improve safety by helping avoid damage to sensitive structures, and enable context-aware robotic assistance during complex procedures. In this work, we propose a novel method for markerless 3D tissue tracking by leveraging 2D Tracking Any Point (TAP) networks. Our method combines two CoTracker models, one for temporal tracking and one for stereo matching, to estimate 3D motion from stereo endoscopic images. We evaluate the system using a clinical laparoscopic setup and a robotic arm simulating tissue motion, with experiments conducted on a synthetic 3D-printed phantom and a chicken tissue phantom. Tracking on the chicken tissue phantom yielded more reliable results, with Euclidean distance errors as low as 1.1 mm at a velocity of 10 mm/s. These findings highlight the potential of TAP-based models for accurate, markerless 3D tracking in challenging surgical scenarios. |
| title | Tracking Any Point Methods for Markerless 3D Tissue Tracking in Endoscopic Stereo Images |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.07851 |