Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929421777108992 |
|---|---|
| author | Zhang, Zhengbo Xu, Li Peng, Duo Rahmani, Hossein Liu, Jun |
| author_facet | Zhang, Zhengbo Xu, Li Peng, Duo Rahmani, Hossein Liu, Jun |
| contents | We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained diffusion model, such as the understanding of image semantics and structural information, to address unsupervised visual tracking. To this end, we design an initial prompt learner to enable the diffusion model to recognize the tracking target by learning a prompt representing the target. Furthermore, to facilitate dynamic adaptation of the prompt to the target's movements, we propose an online prompt updater. Extensive experiments on five benchmark datasets demonstrate the effectiveness of our proposed method, which also achieves state-of-the-art performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_08394 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers Zhang, Zhengbo Xu, Li Peng, Duo Rahmani, Hossein Liu, Jun Computer Vision and Pattern Recognition We introduce Diff-Tracker, a novel approach for the challenging unsupervised visual tracking task leveraging the pre-trained text-to-image diffusion model. Our main idea is to leverage the rich knowledge encapsulated within the pre-trained diffusion model, such as the understanding of image semantics and structural information, to address unsupervised visual tracking. To this end, we design an initial prompt learner to enable the diffusion model to recognize the tracking target by learning a prompt representing the target. Furthermore, to facilitate dynamic adaptation of the prompt to the target's movements, we propose an online prompt updater. Extensive experiments on five benchmark datasets demonstrate the effectiveness of our proposed method, which also achieves state-of-the-art performance. |
| title | Diff-Tracker: Text-to-Image Diffusion Models are Unsupervised Trackers |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.08394 |