UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Siyuan, Zhu, Rui, Wang, Ziqi, Ren, Wenqi, Yan, Yanyang, Cao, Xiaochun
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908429329629184
author Yao, Siyuan
Zhu, Rui
Wang, Ziqi
Ren, Wenqi
Yan, Yanyang
Cao, Xiaochun
author_facet Yao, Siyuan
Zhu, Rui
Wang, Ziqi
Ren, Wenqi
Yan, Yanyang
Cao, Xiaochun
contents Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse weather conditions, e.g. nighttime or foggy environment, the tremendous domain shift leads to significant performance degradation. In this paper, we propose UMDATrack, which is capable of maintaining high-quality target state prediction under various adverse weather conditions within a unified domain adaptation framework. Specifically, we first use a controllable scenario generator to synthesize a small amount of unlabeled videos (less than 2% frames in source daytime datasets) in multiple weather conditions under the guidance of different text prompts. Afterwards, we design a simple yet effective domain-customized adapter (DCA), allowing the target objects' representation to rapidly adapt to various weather conditions without redundant model updating. Furthermore, to enhance the localization consistency between source and target domains, we propose a target-aware confidence alignment module (TCA) following optimal transport theorem. Extensive experiments demonstrate that UMDATrack can surpass existing advanced visual trackers and lead new state-of-the-art performance by a significant margin. Our code is available at https://github.com/Z-Z188/UMDATrack.
format Preprint
id arxiv_https___arxiv_org_abs_2507_00648
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions
Yao, Siyuan
Zhu, Rui
Wang, Ziqi
Ren, Wenqi
Yan, Yanyang
Cao, Xiaochun
Computer Vision and Pattern Recognition
Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse weather conditions, e.g. nighttime or foggy environment, the tremendous domain shift leads to significant performance degradation. In this paper, we propose UMDATrack, which is capable of maintaining high-quality target state prediction under various adverse weather conditions within a unified domain adaptation framework. Specifically, we first use a controllable scenario generator to synthesize a small amount of unlabeled videos (less than 2% frames in source daytime datasets) in multiple weather conditions under the guidance of different text prompts. Afterwards, we design a simple yet effective domain-customized adapter (DCA), allowing the target objects' representation to rapidly adapt to various weather conditions without redundant model updating. Furthermore, to enhance the localization consistency between source and target domains, we propose a target-aware confidence alignment module (TCA) following optimal transport theorem. Extensive experiments demonstrate that UMDATrack can surpass existing advanced visual trackers and lead new state-of-the-art performance by a significant margin. Our code is available at https://github.com/Z-Z188/UMDATrack.
title UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.00648