Semi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rückin, Julius, Magistri, Federico, Stachniss, Cyrill, Popović, Marija
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914653882286080
author Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
author_facet Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
contents Semantic segmentation enables robots to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unknown environments, pre-training on static datasets cannot always capture the variety of domains and limits the robot's perception performance during missions. Recently, self-supervised and fully supervised active learning methods emerged to improve a robot's vision. These approaches rely on large in-domain pre-training datasets or require substantial human labelling effort. We propose a planning method for semi-supervised active learning of semantic segmentation that substantially reduces human labelling requirements compared to fully supervised approaches. We leverage an adaptive map-based planner guided towards the frontiers of unexplored space with high model uncertainty collecting training data for human labelling. A key aspect of our approach is to combine the sparse high-quality human labels with pseudo labels automatically extracted from highly certain environment map areas. Experimental results show that our method reaches segmentation performance close to fully supervised approaches with drastically reduced human labelling effort while outperforming self-supervised approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2312_04402
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Semi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planning
Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
Robotics
Machine Learning
Semantic segmentation enables robots to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unknown environments, pre-training on static datasets cannot always capture the variety of domains and limits the robot's perception performance during missions. Recently, self-supervised and fully supervised active learning methods emerged to improve a robot's vision. These approaches rely on large in-domain pre-training datasets or require substantial human labelling effort. We propose a planning method for semi-supervised active learning of semantic segmentation that substantially reduces human labelling requirements compared to fully supervised approaches. We leverage an adaptive map-based planner guided towards the frontiers of unexplored space with high model uncertainty collecting training data for human labelling. A key aspect of our approach is to combine the sparse high-quality human labels with pseudo labels automatically extracted from highly certain environment map areas. Experimental results show that our method reaches segmentation performance close to fully supervised approaches with drastically reduced human labelling effort while outperforming self-supervised approaches.
title Semi-Supervised Active Learning for Semantic Segmentation in Unknown Environments Using Informative Path Planning
topic Robotics
Machine Learning
url https://arxiv.org/abs/2312.04402