ProTracker: Probabilistic Integration for Robust and Accurate Point Tracking
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912266490740736 |
|---|---|
| author | Zhang, Tingyang Wang, Chen Dou, Zhiyang Gao, Qingzhe Lei, Jiahui Chen, Baoquan Liu, Lingjie |
| author_facet | Zhang, Tingyang Wang, Chen Dou, Zhiyang Gao, Qingzhe Lei, Jiahui Chen, Baoquan Liu, Lingjie |
| contents | We propose ProTracker, a novel framework for accurate and robust long-term dense tracking of arbitrary points in videos. Previous methods relying on global cost volumes effectively handle large occlusions and scene changes but lack precision and temporal awareness. In contrast, local iteration-based methods accurately track smoothly transforming scenes but face challenges with occlusions and drift. To address these issues, we propose a probabilistic framework that marries the strengths of both paradigms by leveraging local optical flow for predictions and refined global heatmaps for observations. This design effectively combines global semantic information with temporally aware low-level features, enabling precise and robust long-term tracking of arbitrary points in videos. Extensive experiments demonstrate that ProTracker attains state-of-the-art performance among optimization-based approaches and surpasses supervised feed-forward methods on multiple benchmarks. The code and model will be released after publication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_03220 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ProTracker: Probabilistic Integration for Robust and Accurate Point Tracking Zhang, Tingyang Wang, Chen Dou, Zhiyang Gao, Qingzhe Lei, Jiahui Chen, Baoquan Liu, Lingjie Computer Vision and Pattern Recognition We propose ProTracker, a novel framework for accurate and robust long-term dense tracking of arbitrary points in videos. Previous methods relying on global cost volumes effectively handle large occlusions and scene changes but lack precision and temporal awareness. In contrast, local iteration-based methods accurately track smoothly transforming scenes but face challenges with occlusions and drift. To address these issues, we propose a probabilistic framework that marries the strengths of both paradigms by leveraging local optical flow for predictions and refined global heatmaps for observations. This design effectively combines global semantic information with temporally aware low-level features, enabling precise and robust long-term tracking of arbitrary points in videos. Extensive experiments demonstrate that ProTracker attains state-of-the-art performance among optimization-based approaches and surpasses supervised feed-forward methods on multiple benchmarks. The code and model will be released after publication. |
| title | ProTracker: Probabilistic Integration for Robust and Accurate Point Tracking |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2501.03220 |