Saved in:
Bibliographic Details
Main Authors: Zhang, Xingguang, Chou, Chih-Hsien
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2404.15252
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914767137931264
author Zhang, Xingguang
Chou, Chih-Hsien
author_facet Zhang, Xingguang
Chou, Chih-Hsien
contents When deploying pre-trained video object detectors in real-world scenarios, the domain gap between training and testing data caused by adverse image conditions often leads to performance degradation. Addressing this issue becomes particularly challenging when only the pre-trained model and degraded videos are available. Although various source-free domain adaptation (SFDA) methods have been proposed for single-frame object detectors, SFDA for video object detection (VOD) remains unexplored. Moreover, most unsupervised domain adaptation works for object detection rely on two-stage detectors, while SFDA for one-stage detectors, which are more vulnerable to fine-tuning, is not well addressed in the literature. In this paper, we propose Spatial-Temporal Alternate Refinement with Mean Teacher (STAR-MT), a simple yet effective SFDA method for VOD. Specifically, we aim to improve the performance of the one-stage VOD method, YOLOV, under adverse image conditions, including noise, air turbulence, and haze. Extensive experiments on the ImageNetVOD dataset and its degraded versions demonstrate that our method consistently improves video object detection performance in challenging imaging conditions, showcasing its potential for real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2404_15252
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Source-free Domain Adaptation for Video Object Detection Under Adverse Image Conditions
Zhang, Xingguang
Chou, Chih-Hsien
Computer Vision and Pattern Recognition
When deploying pre-trained video object detectors in real-world scenarios, the domain gap between training and testing data caused by adverse image conditions often leads to performance degradation. Addressing this issue becomes particularly challenging when only the pre-trained model and degraded videos are available. Although various source-free domain adaptation (SFDA) methods have been proposed for single-frame object detectors, SFDA for video object detection (VOD) remains unexplored. Moreover, most unsupervised domain adaptation works for object detection rely on two-stage detectors, while SFDA for one-stage detectors, which are more vulnerable to fine-tuning, is not well addressed in the literature. In this paper, we propose Spatial-Temporal Alternate Refinement with Mean Teacher (STAR-MT), a simple yet effective SFDA method for VOD. Specifically, we aim to improve the performance of the one-stage VOD method, YOLOV, under adverse image conditions, including noise, air turbulence, and haze. Extensive experiments on the ImageNetVOD dataset and its degraded versions demonstrate that our method consistently improves video object detection performance in challenging imaging conditions, showcasing its potential for real-world applications.
title Source-free Domain Adaptation for Video Object Detection Under Adverse Image Conditions
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2404.15252