Self-Supervised Moving Object Segmentation of Sparse and Noisy Radar Point Clouds

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schwarzer, Leon, Zeller, Matthias, Herraez, Daniel Casado, Dierl, Simon, Heidingsfeld, Michael, Stachniss, Cyrill
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912686952939520
author Schwarzer, Leon
Zeller, Matthias
Herraez, Daniel Casado
Dierl, Simon
Heidingsfeld, Michael
Stachniss, Cyrill
author_facet Schwarzer, Leon
Zeller, Matthias
Herraez, Daniel Casado
Dierl, Simon
Heidingsfeld, Michael
Stachniss, Cyrill
contents Moving object segmentation is a crucial task for safe and reliable autonomous mobile systems like self-driving cars, improving the reliability and robustness of subsequent tasks like SLAM or path planning. While the segmentation of camera or LiDAR data is widely researched and achieves great results, it often introduces an increased latency by requiring the accumulation of temporal sequences to gain the necessary temporal context. Radar sensors overcome this problem with their ability to provide a direct measurement of a point's Doppler velocity, which can be exploited for single-scan moving object segmentation. However, radar point clouds are often sparse and noisy, making data annotation for use in supervised learning very tedious, time-consuming, and cost-intensive. To overcome this problem, we address the task of self-supervised moving object segmentation of sparse and noisy radar point clouds. We follow a two-step approach of contrastive self-supervised representation learning with subsequent supervised fine-tuning using limited amounts of annotated data. We propose a novel clustering-based contrastive loss function with cluster refinement based on dynamic points removal to pretrain the network to produce motion-aware representations of the radar data. Our method improves label efficiency after fine-tuning, effectively boosting state-of-the-art performance by self-supervised pretraining.
format Preprint
id arxiv_https___arxiv_org_abs_2511_02395
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Self-Supervised Moving Object Segmentation of Sparse and Noisy Radar Point Clouds
Schwarzer, Leon
Zeller, Matthias
Herraez, Daniel Casado
Dierl, Simon
Heidingsfeld, Michael
Stachniss, Cyrill
Computer Vision and Pattern Recognition
Machine Learning
Moving object segmentation is a crucial task for safe and reliable autonomous mobile systems like self-driving cars, improving the reliability and robustness of subsequent tasks like SLAM or path planning. While the segmentation of camera or LiDAR data is widely researched and achieves great results, it often introduces an increased latency by requiring the accumulation of temporal sequences to gain the necessary temporal context. Radar sensors overcome this problem with their ability to provide a direct measurement of a point's Doppler velocity, which can be exploited for single-scan moving object segmentation. However, radar point clouds are often sparse and noisy, making data annotation for use in supervised learning very tedious, time-consuming, and cost-intensive. To overcome this problem, we address the task of self-supervised moving object segmentation of sparse and noisy radar point clouds. We follow a two-step approach of contrastive self-supervised representation learning with subsequent supervised fine-tuning using limited amounts of annotated data. We propose a novel clustering-based contrastive loss function with cluster refinement based on dynamic points removal to pretrain the network to produce motion-aware representations of the radar data. Our method improves label efficiency after fine-tuning, effectively boosting state-of-the-art performance by self-supervised pretraining.
title Self-Supervised Moving Object Segmentation of Sparse and Noisy Radar Point Clouds
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2511.02395