UniCalib: Targetless LiDAR-Camera Calibration via Probabilistic Flow on Unified Depth Representations

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Han, Shu, Zhu, Xubo, Wu, Ji, Cai, Ximeng, Yang, Wen, Yu, Huai, Xia, Gui-Song
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912529264934912
author Han, Shu
Zhu, Xubo
Wu, Ji
Cai, Ximeng
Yang, Wen
Yu, Huai
Xia, Gui-Song
author_facet Han, Shu
Zhu, Xubo
Wu, Ji
Cai, Ximeng
Yang, Wen
Yu, Huai
Xia, Gui-Song
contents Precise LiDAR-camera calibration is crucial for integrating these two sensors into robotic systems to achieve robust perception. In applications like autonomous driving, online targetless calibration enables a prompt sensor misalignment correction from mechanical vibrations without extra targets. However, existing methods exhibit limitations in effectively extracting consistent features from LiDAR and camera data and fail to prioritize salient regions, compromising cross-modal alignment robustness. To address these issues, we propose DF-Calib, a LiDAR-camera calibration method that reformulates calibration as an intra-modality depth flow estimation problem. DF-Calib estimates a dense depth map from the camera image and completes the sparse LiDAR projected depth map, using a shared feature encoder to extract consistent depth-to-depth features, effectively bridging the 2D-3D cross-modal gap. Additionally, we introduce a reliability map to prioritize valid pixels and propose a perceptually weighted sparse flow loss to enhance depth flow estimation. Experimental results across multiple datasets validate its accuracy and generalization,with DF-Calib achieving a mean translation error of 0.635cm and rotation error of 0.045 degrees on the KITTI dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2504_01416
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle UniCalib: Targetless LiDAR-Camera Calibration via Probabilistic Flow on Unified Depth Representations
Han, Shu
Zhu, Xubo
Wu, Ji
Cai, Ximeng
Yang, Wen
Yu, Huai
Xia, Gui-Song
Robotics
Computer Vision and Pattern Recognition
Precise LiDAR-camera calibration is crucial for integrating these two sensors into robotic systems to achieve robust perception. In applications like autonomous driving, online targetless calibration enables a prompt sensor misalignment correction from mechanical vibrations without extra targets. However, existing methods exhibit limitations in effectively extracting consistent features from LiDAR and camera data and fail to prioritize salient regions, compromising cross-modal alignment robustness. To address these issues, we propose DF-Calib, a LiDAR-camera calibration method that reformulates calibration as an intra-modality depth flow estimation problem. DF-Calib estimates a dense depth map from the camera image and completes the sparse LiDAR projected depth map, using a shared feature encoder to extract consistent depth-to-depth features, effectively bridging the 2D-3D cross-modal gap. Additionally, we introduce a reliability map to prioritize valid pixels and propose a perceptually weighted sparse flow loss to enhance depth flow estimation. Experimental results across multiple datasets validate its accuracy and generalization,with DF-Calib achieving a mean translation error of 0.635cm and rotation error of 0.045 degrees on the KITTI dataset.
title UniCalib: Targetless LiDAR-Camera Calibration via Probabilistic Flow on Unified Depth Representations
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.01416