RCDINO: Enhancing Radar-Camera 3D Object Detection with DINOv2 Semantic Features

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Matykina, Olga, Yudin, Dmitry
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912546511912960
author Matykina, Olga
Yudin, Dmitry
author_facet Matykina, Olga
Yudin, Dmitry
contents Three-dimensional object detection is essential for autonomous driving and robotics, relying on effective fusion of multimodal data from cameras and radar. This work proposes RCDINO, a multimodal transformer-based model that enhances visual backbone features by fusing them with semantically rich representations from the pretrained DINOv2 foundation model. This approach enriches visual representations and improves the model's detection performance while preserving compatibility with the baseline architecture. Experiments on the nuScenes dataset demonstrate that RCDINO achieves state-of-the-art performance among radar-camera models, with 56.4 NDS and 48.1 mAP. Our implementation is available at https://github.com/OlgaMatykina/RCDINO.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15353
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RCDINO: Enhancing Radar-Camera 3D Object Detection with DINOv2 Semantic Features
Matykina, Olga
Yudin, Dmitry
Computer Vision and Pattern Recognition
Three-dimensional object detection is essential for autonomous driving and robotics, relying on effective fusion of multimodal data from cameras and radar. This work proposes RCDINO, a multimodal transformer-based model that enhances visual backbone features by fusing them with semantically rich representations from the pretrained DINOv2 foundation model. This approach enriches visual representations and improves the model's detection performance while preserving compatibility with the baseline architecture. Experiments on the nuScenes dataset demonstrate that RCDINO achieves state-of-the-art performance among radar-camera models, with 56.4 NDS and 48.1 mAP. Our implementation is available at https://github.com/OlgaMatykina/RCDINO.
title RCDINO: Enhancing Radar-Camera 3D Object Detection with DINOv2 Semantic Features
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.15353