LiteTracker: Leveraging Temporal Causality for Accurate Low-latency Tissue Tracking

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Karaoglu, Mert Asim, Ji, Wenbo, Abbas, Ahmed, Navab, Nassir, Busam, Benjamin, Ladikos, Alexander
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909881317982208
author Karaoglu, Mert Asim
Ji, Wenbo
Abbas, Ahmed
Navab, Nassir
Busam, Benjamin
Ladikos, Alexander
author_facet Karaoglu, Mert Asim
Ji, Wenbo
Abbas, Ahmed
Navab, Nassir
Busam, Benjamin
Ladikos, Alexander
contents Tissue tracking plays a critical role in various surgical navigation and extended reality (XR) applications. While current methods trained on large synthetic datasets achieve high tracking accuracy and generalize well to endoscopic scenes, their runtime performances fail to meet the low-latency requirements necessary for real-time surgical applications. To address this limitation, we propose LiteTracker, a low-latency method for tissue tracking in endoscopic video streams. LiteTracker builds on a state-of-the-art long-term point tracking method, and introduces a set of training-free runtime optimizations. These optimizations enable online, frame-by-frame tracking by leveraging a temporal memory buffer for efficient feature reuse and utilizing prior motion for accurate track initialization. LiteTracker demonstrates significant runtime improvements being around 7x faster than its predecessor and 2x than the state-of-the-art. Beyond its primary focus on efficiency, LiteTracker delivers high-accuracy tracking and occlusion prediction, performing competitively on both the STIR and SuPer datasets. We believe LiteTracker is an important step toward low-latency tissue tracking for real-time surgical applications in the operating room. Our code is publicly available at https://github.com/ImFusionGmbH/lite-tracker.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09904
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LiteTracker: Leveraging Temporal Causality for Accurate Low-latency Tissue Tracking
Karaoglu, Mert Asim
Ji, Wenbo
Abbas, Ahmed
Navab, Nassir
Busam, Benjamin
Ladikos, Alexander
Computer Vision and Pattern Recognition
Tissue tracking plays a critical role in various surgical navigation and extended reality (XR) applications. While current methods trained on large synthetic datasets achieve high tracking accuracy and generalize well to endoscopic scenes, their runtime performances fail to meet the low-latency requirements necessary for real-time surgical applications. To address this limitation, we propose LiteTracker, a low-latency method for tissue tracking in endoscopic video streams. LiteTracker builds on a state-of-the-art long-term point tracking method, and introduces a set of training-free runtime optimizations. These optimizations enable online, frame-by-frame tracking by leveraging a temporal memory buffer for efficient feature reuse and utilizing prior motion for accurate track initialization. LiteTracker demonstrates significant runtime improvements being around 7x faster than its predecessor and 2x than the state-of-the-art. Beyond its primary focus on efficiency, LiteTracker delivers high-accuracy tracking and occlusion prediction, performing competitively on both the STIR and SuPer datasets. We believe LiteTracker is an important step toward low-latency tissue tracking for real-time surgical applications in the operating room. Our code is publicly available at https://github.com/ImFusionGmbH/lite-tracker.
title LiteTracker: Leveraging Temporal Causality for Accurate Low-latency Tissue Tracking
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.09904