Railway LiDAR semantic segmentation based on intelligent semi-automated data annotation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wulff, Florian, Schaeufele, Bernd, Pfeifer, Julian, Radusch, Ilja
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912407112122368
author Wulff, Florian
Schaeufele, Bernd
Pfeifer, Julian
Radusch, Ilja
author_facet Wulff, Florian
Schaeufele, Bernd
Pfeifer, Julian
Radusch, Ilja
contents Automated vehicles rely on an accurate and robust perception of the environment. Similarly to automated cars, highly automated trains require an environmental perception. Although there is a lot of research based on either camera or LiDAR sensors in the automotive domain, very few contributions for this task exist yet for automated trains. Additionally, no public dataset or described approach for a 3D LiDAR semantic segmentation in the railway environment exists yet. Thus, we propose an approach for a point-wise 3D semantic segmentation based on the 2DPass network architecture using scans and images jointly. In addition, we present a semi-automated intelligent data annotation approach, which we use to efficiently and accurately label the required dataset recorded on a railway track in Germany. To improve performance despite a still small number of labeled scans, we apply an active learning approach to intelligently select scans for the training dataset. Our contributions are threefold: We annotate rail data including camera and LiDAR data from the railway environment, transfer label the raw LiDAR point clouds using an image segmentation network, and train a state-of-the-art 3D LiDAR semantic segmentation network efficiently leveraging active learning. The trained network achieves good segmentation results with a mean IoU of 71.48% of 9 classes.
format Preprint
id arxiv_https___arxiv_org_abs_2410_13383
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Railway LiDAR semantic segmentation based on intelligent semi-automated data annotation
Wulff, Florian
Schaeufele, Bernd
Pfeifer, Julian
Radusch, Ilja
Computer Vision and Pattern Recognition
Systems and Control
Automated vehicles rely on an accurate and robust perception of the environment. Similarly to automated cars, highly automated trains require an environmental perception. Although there is a lot of research based on either camera or LiDAR sensors in the automotive domain, very few contributions for this task exist yet for automated trains. Additionally, no public dataset or described approach for a 3D LiDAR semantic segmentation in the railway environment exists yet. Thus, we propose an approach for a point-wise 3D semantic segmentation based on the 2DPass network architecture using scans and images jointly. In addition, we present a semi-automated intelligent data annotation approach, which we use to efficiently and accurately label the required dataset recorded on a railway track in Germany. To improve performance despite a still small number of labeled scans, we apply an active learning approach to intelligently select scans for the training dataset. Our contributions are threefold: We annotate rail data including camera and LiDAR data from the railway environment, transfer label the raw LiDAR point clouds using an image segmentation network, and train a state-of-the-art 3D LiDAR semantic segmentation network efficiently leveraging active learning. The trained network achieves good segmentation results with a mean IoU of 71.48% of 9 classes.
title Railway LiDAR semantic segmentation based on intelligent semi-automated data annotation
topic Computer Vision and Pattern Recognition
Systems and Control
url https://arxiv.org/abs/2410.13383