Uni$^2$Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910625447280640 |
|---|---|
| author | Wang, Yubin Zou, Zhikang Ye, Xiaoqing Tan, Xiao Ding, Errui Zhao, Cairong |
| author_facet | Wang, Yubin Zou, Zhikang Ye, Xiaoqing Tan, Xiao Ding, Errui Zhao, Cairong |
| contents | We present Uni$^2$Det, a brand new framework for unified and universal multi-dataset training on 3D detection, enabling robust performance across diverse domains and generalization to unseen domains. Due to substantial disparities in data distribution and variations in taxonomy across diverse domains, training such a detector by simply merging datasets poses a significant challenge. Motivated by this observation, we introduce multi-stage prompting modules for multi-dataset 3D detection, which leverages prompts based on the characteristics of corresponding datasets to mitigate existing differences. This elegant design facilitates seamless plug-and-play integration within various advanced 3D detection frameworks in a unified manner, while also allowing straightforward adaptation for universal applicability across datasets. Experiments are conducted across multiple dataset consolidation scenarios involving KITTI, Waymo, and nuScenes, demonstrating that our Uni$^2$Det outperforms existing methods by a large margin in multi-dataset training. Notably, results on zero-shot cross-dataset transfer validate the generalization capability of our proposed method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_20558 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Uni$^2$Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection Wang, Yubin Zou, Zhikang Ye, Xiaoqing Tan, Xiao Ding, Errui Zhao, Cairong Computer Vision and Pattern Recognition We present Uni$^2$Det, a brand new framework for unified and universal multi-dataset training on 3D detection, enabling robust performance across diverse domains and generalization to unseen domains. Due to substantial disparities in data distribution and variations in taxonomy across diverse domains, training such a detector by simply merging datasets poses a significant challenge. Motivated by this observation, we introduce multi-stage prompting modules for multi-dataset 3D detection, which leverages prompts based on the characteristics of corresponding datasets to mitigate existing differences. This elegant design facilitates seamless plug-and-play integration within various advanced 3D detection frameworks in a unified manner, while also allowing straightforward adaptation for universal applicability across datasets. Experiments are conducted across multiple dataset consolidation scenarios involving KITTI, Waymo, and nuScenes, demonstrating that our Uni$^2$Det outperforms existing methods by a large margin in multi-dataset training. Notably, results on zero-shot cross-dataset transfer validate the generalization capability of our proposed method. |
| title | Uni$^2$Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.20558 |