CoopDETR: A Unified Cooperative Perception Framework for 3D Detection via Object Query
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915174002196480 |
|---|---|
| author | Wang, Zhe Xu, Shaocong Zhuang, Xucai Xu, Tongda Wang, Yan Liu, Jingjing Chen, Yilun Zhang, Ya-Qin |
| author_facet | Wang, Zhe Xu, Shaocong Zhuang, Xucai Xu, Tongda Wang, Yan Liu, Jingjing Chen, Yilun Zhang, Ya-Qin |
| contents | Cooperative perception enhances the individual perception capabilities of autonomous vehicles (AVs) by providing a comprehensive view of the environment. However, balancing perception performance and transmission costs remains a significant challenge. Current approaches that transmit region-level features across agents are limited in interpretability and demand substantial bandwidth, making them unsuitable for practical applications. In this work, we propose CoopDETR, a novel cooperative perception framework that introduces object-level feature cooperation via object query. Our framework consists of two key modules: single-agent query generation, which efficiently encodes raw sensor data into object queries, reducing transmission cost while preserving essential information for detection; and cross-agent query fusion, which includes Spatial Query Matching (SQM) and Object Query Aggregation (OQA) to enable effective interaction between queries. Our experiments on the OPV2V and V2XSet datasets demonstrate that CoopDETR achieves state-of-the-art performance and significantly reduces transmission costs to 1/782 of previous methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19313 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | CoopDETR: A Unified Cooperative Perception Framework for 3D Detection via Object Query Wang, Zhe Xu, Shaocong Zhuang, Xucai Xu, Tongda Wang, Yan Liu, Jingjing Chen, Yilun Zhang, Ya-Qin Computer Vision and Pattern Recognition Cooperative perception enhances the individual perception capabilities of autonomous vehicles (AVs) by providing a comprehensive view of the environment. However, balancing perception performance and transmission costs remains a significant challenge. Current approaches that transmit region-level features across agents are limited in interpretability and demand substantial bandwidth, making them unsuitable for practical applications. In this work, we propose CoopDETR, a novel cooperative perception framework that introduces object-level feature cooperation via object query. Our framework consists of two key modules: single-agent query generation, which efficiently encodes raw sensor data into object queries, reducing transmission cost while preserving essential information for detection; and cross-agent query fusion, which includes Spatial Query Matching (SQM) and Object Query Aggregation (OQA) to enable effective interaction between queries. Our experiments on the OPV2V and V2XSet datasets demonstrate that CoopDETR achieves state-of-the-art performance and significantly reduces transmission costs to 1/782 of previous methods. |
| title | CoopDETR: A Unified Cooperative Perception Framework for 3D Detection via Object Query |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2502.19313 |