Robust LiDAR-Camera Calibration with 2D Gaussian Splatting

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Shuyi, Xie, Shuxiang, Ishikawa, Ryoichi, Oishi, Takeshi
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909560405491712
author Zhou, Shuyi
Xie, Shuxiang
Ishikawa, Ryoichi
Oishi, Takeshi
author_facet Zhou, Shuyi
Xie, Shuxiang
Ishikawa, Ryoichi
Oishi, Takeshi
contents LiDAR-camera systems have become increasingly popular in robotics recently. A critical and initial step in integrating the LiDAR and camera data is the calibration of the LiDAR-camera system. Most existing calibration methods rely on auxiliary target objects, which often involve complex manual operations, whereas targetless methods have yet to achieve practical effectiveness. Recognizing that 2D Gaussian Splatting (2DGS) can reconstruct geometric information from camera image sequences, we propose a calibration method that estimates LiDAR-camera extrinsic parameters using geometric constraints. The proposed method begins by reconstructing colorless 2DGS using LiDAR point clouds. Subsequently, we update the colors of the Gaussian splats by minimizing the photometric loss. The extrinsic parameters are optimized during this process. Additionally, we address the limitations of the photometric loss by incorporating the reprojection and triangulation losses, thereby enhancing the calibration robustness and accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2504_00525
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robust LiDAR-Camera Calibration with 2D Gaussian Splatting
Zhou, Shuyi
Xie, Shuxiang
Ishikawa, Ryoichi
Oishi, Takeshi
Robotics
Computer Vision and Pattern Recognition
LiDAR-camera systems have become increasingly popular in robotics recently. A critical and initial step in integrating the LiDAR and camera data is the calibration of the LiDAR-camera system. Most existing calibration methods rely on auxiliary target objects, which often involve complex manual operations, whereas targetless methods have yet to achieve practical effectiveness. Recognizing that 2D Gaussian Splatting (2DGS) can reconstruct geometric information from camera image sequences, we propose a calibration method that estimates LiDAR-camera extrinsic parameters using geometric constraints. The proposed method begins by reconstructing colorless 2DGS using LiDAR point clouds. Subsequently, we update the colors of the Gaussian splats by minimizing the photometric loss. The extrinsic parameters are optimized during this process. Additionally, we address the limitations of the photometric loss by incorporating the reprojection and triangulation losses, thereby enhancing the calibration robustness and accuracy.
title Robust LiDAR-Camera Calibration with 2D Gaussian Splatting
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.00525