LiREC-Net: A Target-Free and Learning-Based Network for LiDAR, RGB, and Event Calibration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dash, Aditya Ranjan, Battrawy, Ramy, Schuster, René, Stricker, Didier
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908852172095488
author Dash, Aditya Ranjan
Battrawy, Ramy
Schuster, René
Stricker, Didier
author_facet Dash, Aditya Ranjan
Battrawy, Ramy
Schuster, René
Stricker, Didier
contents Advanced autonomous systems rely on multi-sensor fusion for safer and more robust perception. To enable effective fusion, calibrating directly from natural driving scenes (i.e., target-free) with high accuracy is crucial for precise multi-sensor alignment. Existing learning-based calibration methods are typically designed for only a single pair of sensor modalities (i.e., a bi-modal setup). Unlike these methods, we propose LiREC-Net, a target-free, learning-based calibration network that jointly calibrates multiple sensor modality pairs, including LiDAR, RGB, and event data, within a unified framework. To reduce redundant computation and improve efficiency, we introduce a shared LiDAR representation that leverages features from both its 3D nature and projected depth map, ensuring better consistency across modalities. Trained and evaluated on established datasets, such as KITTI and DSEC, our LiREC-Net achieves competitive performance to bi-modal models and sets a new strong baseline for the tri-modal use case.
format Preprint
id arxiv_https___arxiv_org_abs_2602_21754
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LiREC-Net: A Target-Free and Learning-Based Network for LiDAR, RGB, and Event Calibration
Dash, Aditya Ranjan
Battrawy, Ramy
Schuster, René
Stricker, Didier
Computer Vision and Pattern Recognition
Advanced autonomous systems rely on multi-sensor fusion for safer and more robust perception. To enable effective fusion, calibrating directly from natural driving scenes (i.e., target-free) with high accuracy is crucial for precise multi-sensor alignment. Existing learning-based calibration methods are typically designed for only a single pair of sensor modalities (i.e., a bi-modal setup). Unlike these methods, we propose LiREC-Net, a target-free, learning-based calibration network that jointly calibrates multiple sensor modality pairs, including LiDAR, RGB, and event data, within a unified framework. To reduce redundant computation and improve efficiency, we introduce a shared LiDAR representation that leverages features from both its 3D nature and projected depth map, ensuring better consistency across modalities. Trained and evaluated on established datasets, such as KITTI and DSEC, our LiREC-Net achieves competitive performance to bi-modal models and sets a new strong baseline for the tri-modal use case.
title LiREC-Net: A Target-Free and Learning-Based Network for LiDAR, RGB, and Event Calibration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.21754