Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Jialong, Wang, Yihan, Rottmann, Matthias
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918471716044800
author Wu, Jialong
Wang, Yihan
Rottmann, Matthias
author_facet Wu, Jialong
Wang, Yihan
Rottmann, Matthias
contents In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm, termed heterogeneous query interaction, and present ConFusion, a camera-radar 3D object detector. ConFusion combines image queries, radar queries, and learnable world queries distributed in 3D space to improve query initialization and object coverage. To encourage cross-type interaction among heterogeneous queries, we introduce heterogeneous query mixing (QMix), which performs dedicated cross-type attention after feature sampling to consolidate complementary object evidence. We further propose interactive query swap sampling (QSwap), which improves feature sampling by allowing related queries to exchange informative feature tokens under attention and geometric constraints. Experiments on the nuScenes dataset show that ConFusion achieves state-of-the-art performance, reaching 59.1 mAP and 65.6 NDS on the validation set, and 61.6 mAP and 67.9 NDS on the test set.
format Preprint
id arxiv_https___arxiv_org_abs_2604_25574
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion
Wu, Jialong
Wang, Yihan
Rottmann, Matthias
Computer Vision and Pattern Recognition
In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm, termed heterogeneous query interaction, and present ConFusion, a camera-radar 3D object detector. ConFusion combines image queries, radar queries, and learnable world queries distributed in 3D space to improve query initialization and object coverage. To encourage cross-type interaction among heterogeneous queries, we introduce heterogeneous query mixing (QMix), which performs dedicated cross-type attention after feature sampling to consolidate complementary object evidence. We further propose interactive query swap sampling (QSwap), which improves feature sampling by allowing related queries to exchange informative feature tokens under attention and geometric constraints. Experiments on the nuScenes dataset show that ConFusion achieves state-of-the-art performance, reaching 59.1 mAP and 65.6 NDS on the validation set, and 61.6 mAP and 67.9 NDS on the test set.
title Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.25574