From One to the Power of Many: Invariance to Multi-LiDAR Perception from Single-Sensor Datasets

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Uecker, Marc, Zöllner, J. Marius
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915118936227840
author Uecker, Marc
Zöllner, J. Marius
author_facet Uecker, Marc
Zöllner, J. Marius
contents Recently, LiDAR segmentation methods for autonomous vehicles, powered by deep neural networks, have experienced steep growth in performance on classic benchmarks, such as nuScenes and SemanticKITTI. However, there are still large gaps in performance when deploying models trained on such single-sensor setups to modern vehicles with multiple high-resolution LiDAR sensors. In this work, we introduce a new metric for feature-level invariance which can serve as a proxy to measure cross-domain generalization without requiring labeled data. Additionally, we propose two application-specific data augmentations, which facilitate better transfer to multi-sensor LiDAR setups, when trained on single-sensor datasets. We provide experimental evidence on both simulated and real data, that our proposed augmentations improve invariance across LiDAR setups, leading to improved generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18592
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From One to the Power of Many: Invariance to Multi-LiDAR Perception from Single-Sensor Datasets
Uecker, Marc
Zöllner, J. Marius
Computer Vision and Pattern Recognition
Robotics
Recently, LiDAR segmentation methods for autonomous vehicles, powered by deep neural networks, have experienced steep growth in performance on classic benchmarks, such as nuScenes and SemanticKITTI. However, there are still large gaps in performance when deploying models trained on such single-sensor setups to modern vehicles with multiple high-resolution LiDAR sensors. In this work, we introduce a new metric for feature-level invariance which can serve as a proxy to measure cross-domain generalization without requiring labeled data. Additionally, we propose two application-specific data augmentations, which facilitate better transfer to multi-sensor LiDAR setups, when trained on single-sensor datasets. We provide experimental evidence on both simulated and real data, that our proposed augmentations improve invariance across LiDAR setups, leading to improved generalization.
title From One to the Power of Many: Invariance to Multi-LiDAR Perception from Single-Sensor Datasets
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2409.18592