Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908020073562112 |
|---|---|
| author | Li, Jinlong Xu, Runsheng Liu, Xinyu Ma, Jin Li, Baolu Zou, Qin Ma, Jiaqi Yu, Hongkai |
| author_facet | Li, Jinlong Xu, Runsheng Liu, Xinyu Ma, Jin Li, Baolu Zou, Qin Ma, Jiaqi Yu, Hongkai |
| contents | Typically, object detection methods for autonomous driving that rely on supervised learning make the assumption of a consistent feature distribution between the training and testing data, this such assumption may fail in different weather conditions. Due to the domain gap, a detection model trained under clear weather may not perform well in foggy and rainy conditions. Overcoming detection bottlenecks in foggy and rainy weather is a real challenge for autonomous vehicles deployed in the wild. To bridge the domain gap and improve the performance of object detection in foggy and rainy weather, this paper presents a novel framework for domain-adaptive object detection. The adaptations at both the image-level and object-level are intended to minimize the differences in image style and object appearance between domains. Furthermore, in order to improve the model's performance on challenging examples, we introduce a novel adversarial gradient reversal layer that conducts adversarial mining on difficult instances in addition to domain adaptation. Additionally, we suggest generating an auxiliary domain through data augmentation to enforce a new domain-level metric regularization. Experimental findings on public benchmark exhibit a substantial enhancement in object detection specifically for foggy and rainy driving scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_09676 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather Li, Jinlong Xu, Runsheng Liu, Xinyu Ma, Jin Li, Baolu Zou, Qin Ma, Jiaqi Yu, Hongkai Computer Vision and Pattern Recognition Typically, object detection methods for autonomous driving that rely on supervised learning make the assumption of a consistent feature distribution between the training and testing data, this such assumption may fail in different weather conditions. Due to the domain gap, a detection model trained under clear weather may not perform well in foggy and rainy conditions. Overcoming detection bottlenecks in foggy and rainy weather is a real challenge for autonomous vehicles deployed in the wild. To bridge the domain gap and improve the performance of object detection in foggy and rainy weather, this paper presents a novel framework for domain-adaptive object detection. The adaptations at both the image-level and object-level are intended to minimize the differences in image style and object appearance between domains. Furthermore, in order to improve the model's performance on challenging examples, we introduce a novel adversarial gradient reversal layer that conducts adversarial mining on difficult instances in addition to domain adaptation. Additionally, we suggest generating an auxiliary domain through data augmentation to enforce a new domain-level metric regularization. Experimental findings on public benchmark exhibit a substantial enhancement in object detection specifically for foggy and rainy driving scenarios. |
| title | Domain Adaptation based Object Detection for Autonomous Driving in Foggy and Rainy Weather |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2307.09676 |