Saved in:
Bibliographic Details
Main Authors: Herau, Quentin, Bennehar, Moussab, Moreau, Arthur, Piasco, Nathan, Roldao, Luis, Tsishkou, Dzmitry, Migniot, Cyrille, Vasseur, Pascal, Demonceaux, Cédric
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.11577
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913505038303232
author Herau, Quentin
Bennehar, Moussab
Moreau, Arthur
Piasco, Nathan
Roldao, Luis
Tsishkou, Dzmitry
Migniot, Cyrille
Vasseur, Pascal
Demonceaux, Cédric
author_facet Herau, Quentin
Bennehar, Moussab
Moreau, Arthur
Piasco, Nathan
Roldao, Luis
Tsishkou, Dzmitry
Migniot, Cyrille
Vasseur, Pascal
Demonceaux, Cédric
contents Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless, such methods are inherently slow to train given the high computational overhead caused by the large number of sampled points required for volume rendering. With the recent introduction of 3D Gaussian Splatting as a faster alternative to implicit representation methods, we propose to leverage this new rendering approach to achieve faster multi-sensor calibration. We introduce 3DGS-Calib, a new calibration method that relies on the speed and rendering accuracy of 3D Gaussian Splatting to achieve multimodal spatiotemporal calibration that is accurate, robust, and with a substantial speed-up compared to methods relying on implicit neural representations. We demonstrate the superiority of our proposal with experimental results on sequences from KITTI-360, a widely used driving dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2403_11577
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle 3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration
Herau, Quentin
Bennehar, Moussab
Moreau, Arthur
Piasco, Nathan
Roldao, Luis
Tsishkou, Dzmitry
Migniot, Cyrille
Vasseur, Pascal
Demonceaux, Cédric
Computer Vision and Pattern Recognition
Robotics
Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless, such methods are inherently slow to train given the high computational overhead caused by the large number of sampled points required for volume rendering. With the recent introduction of 3D Gaussian Splatting as a faster alternative to implicit representation methods, we propose to leverage this new rendering approach to achieve faster multi-sensor calibration. We introduce 3DGS-Calib, a new calibration method that relies on the speed and rendering accuracy of 3D Gaussian Splatting to achieve multimodal spatiotemporal calibration that is accurate, robust, and with a substantial speed-up compared to methods relying on implicit neural representations. We demonstrate the superiority of our proposal with experimental results on sequences from KITTI-360, a widely used driving dataset.
title 3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2403.11577