A Vanilla Multi-Task Framework for Dense Visual Prediction Solution to 1st VCL Challenge -- Multi-Task Robustness Track

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Zehui, Wang, Qiuchen, Li, Zhenyu, Liu, Jiaming, Zhang, Shanghang, Zhao, Feng
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929257904603136
author Chen, Zehui
Wang, Qiuchen
Li, Zhenyu
Liu, Jiaming
Zhang, Shanghang
Zhao, Feng
author_facet Chen, Zehui
Wang, Qiuchen
Li, Zhenyu
Liu, Jiaming
Zhang, Shanghang
Zhao, Feng
contents In this report, we present our solution to the multi-task robustness track of the 1st Visual Continual Learning (VCL) Challenge at ICCV 2023 Workshop. We propose a vanilla framework named UniNet that seamlessly combines various visual perception algorithms into a multi-task model. Specifically, we choose DETR3D, Mask2Former, and BinsFormer for 3D object detection, instance segmentation, and depth estimation tasks, respectively. The final submission is a single model with InternImage-L backbone, and achieves a 49.6 overall score (29.5 Det mAP, 80.3 mTPS, 46.4 Seg mAP, and 7.93 silog) on SHIFT validation set. Besides, we provide some interesting observations in our experiments which may facilitate the development of multi-task learning in dense visual prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2402_17319
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Vanilla Multi-Task Framework for Dense Visual Prediction Solution to 1st VCL Challenge -- Multi-Task Robustness Track
Chen, Zehui
Wang, Qiuchen
Li, Zhenyu
Liu, Jiaming
Zhang, Shanghang
Zhao, Feng
Computer Vision and Pattern Recognition
In this report, we present our solution to the multi-task robustness track of the 1st Visual Continual Learning (VCL) Challenge at ICCV 2023 Workshop. We propose a vanilla framework named UniNet that seamlessly combines various visual perception algorithms into a multi-task model. Specifically, we choose DETR3D, Mask2Former, and BinsFormer for 3D object detection, instance segmentation, and depth estimation tasks, respectively. The final submission is a single model with InternImage-L backbone, and achieves a 49.6 overall score (29.5 Det mAP, 80.3 mTPS, 46.4 Seg mAP, and 7.93 silog) on SHIFT validation set. Besides, we provide some interesting observations in our experiments which may facilitate the development of multi-task learning in dense visual prediction.
title A Vanilla Multi-Task Framework for Dense Visual Prediction Solution to 1st VCL Challenge -- Multi-Task Robustness Track
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.17319