Imaging radar and LiDAR image translation for 3-DOF extrinsic calibration

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jung, Sangwoo, Jang, Hyesu, Jung, Minwoo, Kim, Ayoung, Jeon, Myung-Hwan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913286298009600
author Jung, Sangwoo
Jang, Hyesu
Jung, Minwoo
Kim, Ayoung
Jeon, Myung-Hwan
author_facet Jung, Sangwoo
Jang, Hyesu
Jung, Minwoo
Kim, Ayoung
Jeon, Myung-Hwan
contents The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative transformation, between each sensor. The use of data fusion between complementary sensors, such as radar and LiDAR, can provide significant benefits, particularly in harsh environments where accurate depth data is required. However, noise included in radar sensor data can make the estimation of extrinsic calibration challenging. To address this issue, we present a novel framework for the extrinsic calibration of radar and LiDAR sensors, utilizing CycleGAN as amethod of image-to-image translation. Our proposed method employs translating radar bird-eye-view images into LiDAR-style images to estimate the 3-DOF extrinsic parameters. The use of image registration techniques, as well as deskewing based on sensor odometry and B-spline interpolation, is employed to address the rolling shutter effect commonly present in spinning sensors. Our method demonstrates a notable improvement in extrinsic calibration compared to filter-based methods using the MulRan dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2403_18358
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Imaging radar and LiDAR image translation for 3-DOF extrinsic calibration
Jung, Sangwoo
Jang, Hyesu
Jung, Minwoo
Kim, Ayoung
Jeon, Myung-Hwan
Robotics
The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative transformation, between each sensor. The use of data fusion between complementary sensors, such as radar and LiDAR, can provide significant benefits, particularly in harsh environments where accurate depth data is required. However, noise included in radar sensor data can make the estimation of extrinsic calibration challenging. To address this issue, we present a novel framework for the extrinsic calibration of radar and LiDAR sensors, utilizing CycleGAN as amethod of image-to-image translation. Our proposed method employs translating radar bird-eye-view images into LiDAR-style images to estimate the 3-DOF extrinsic parameters. The use of image registration techniques, as well as deskewing based on sensor odometry and B-spline interpolation, is employed to address the rolling shutter effect commonly present in spinning sensors. Our method demonstrates a notable improvement in extrinsic calibration compared to filter-based methods using the MulRan dataset.
title Imaging radar and LiDAR image translation for 3-DOF extrinsic calibration
topic Robotics
url https://arxiv.org/abs/2403.18358