Saved in:
Bibliographic Details
Main Authors: Wu, Zhize, Wang, Xiaofeng, Xu, Tong, Yang, Xuebin, Zou, Le, Xu, Lixiang, Weise, Thomas
Format: Preprint
Published: 2022
Subjects:
Online Access:https://arxiv.org/abs/2202.05941
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910288018669568
author Wu, Zhize
Wang, Xiaofeng
Xu, Tong
Yang, Xuebin
Zou, Le
Xu, Lixiang
Weise, Thomas
author_facet Wu, Zhize
Wang, Xiaofeng
Xu, Tong
Yang, Xuebin
Zou, Le
Xu, Lixiang
Weise, Thomas
contents Object recognition from images means to automatically find object(s) of interest and to return their category and location information. Benefiting from research on deep learning, like convolutional neural networks~(CNNs) and generative adversarial networks, the performance in this field has been improved significantly, especially when training and test data are drawn from similar distributions. However, mismatching distributions, i.e., domain shifts, lead to a significant performance drop. In this paper, we build domain-invariant detectors by learning domain classifiers via adversarial training. Based on the previous works that align image and instance level features, we mitigate the domain shift further by introducing a domain adaptation component at the region level within Faster \mbox{R-CNN}. We embed a domain classification network in the region proposal network~(RPN) using adversarial learning. The RPN can now generate accurate region proposals in different domains by effectively aligning the features between them. To mitigate the unstable convergence during the adversarial learning, we introduce a balanced domain classifier as well as a network learning rate adjustment strategy. We conduct comprehensive experiments using four standard datasets. The results demonstrate the effectiveness and robustness of our object detection approach in domain shift scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2202_05941
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Domain-Invariant Proposals based on a Balanced Domain Classifier for Object Detection
Wu, Zhize
Wang, Xiaofeng
Xu, Tong
Yang, Xuebin
Zou, Le
Xu, Lixiang
Weise, Thomas
Computer Vision and Pattern Recognition
Object recognition from images means to automatically find object(s) of interest and to return their category and location information. Benefiting from research on deep learning, like convolutional neural networks~(CNNs) and generative adversarial networks, the performance in this field has been improved significantly, especially when training and test data are drawn from similar distributions. However, mismatching distributions, i.e., domain shifts, lead to a significant performance drop. In this paper, we build domain-invariant detectors by learning domain classifiers via adversarial training. Based on the previous works that align image and instance level features, we mitigate the domain shift further by introducing a domain adaptation component at the region level within Faster \mbox{R-CNN}. We embed a domain classification network in the region proposal network~(RPN) using adversarial learning. The RPN can now generate accurate region proposals in different domains by effectively aligning the features between them. To mitigate the unstable convergence during the adversarial learning, we introduce a balanced domain classifier as well as a network learning rate adjustment strategy. We conduct comprehensive experiments using four standard datasets. The results demonstrate the effectiveness and robustness of our object detection approach in domain shift scenarios.
title Domain-Invariant Proposals based on a Balanced Domain Classifier for Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2202.05941