Active Learning of Robot Vision Using Adaptive Path Planning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rückin, Julius, Magistri, Federico, Stachniss, Cyrill, Popović, Marija
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912072552415232
author Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
author_facet Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
contents Robots need robust and flexible vision systems to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unknown environments, pre-training on static datasets cannot always capture the variety of domains and limits the robot's vision performance during missions. Recently, self-supervised as well as fully supervised active learning methods emerged to improve robotic vision. These approaches rely on large in-domain pre-training datasets or require substantial human labelling effort. To address these issues, we present a recent adaptive planning framework for efficient training data collection to substantially reduce human labelling requirements in semantic terrain monitoring missions. To this end, we combine high-quality human labels with automatically generated pseudo labels. Experimental results show that the framework reaches segmentation performance close to fully supervised approaches with drastically reduced human labelling effort while outperforming purely self-supervised approaches. We discuss the advantages and limitations of current methods and outline valuable future research avenues towards more robust and flexible robotic vision systems in unknown environments.
format Preprint
id arxiv_https___arxiv_org_abs_2410_10684
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Active Learning of Robot Vision Using Adaptive Path Planning
Rückin, Julius
Magistri, Federico
Stachniss, Cyrill
Popović, Marija
Robotics
Robots need robust and flexible vision systems to perceive and reason about their environments beyond geometry. Most of such systems build upon deep learning approaches. As autonomous robots are commonly deployed in initially unknown environments, pre-training on static datasets cannot always capture the variety of domains and limits the robot's vision performance during missions. Recently, self-supervised as well as fully supervised active learning methods emerged to improve robotic vision. These approaches rely on large in-domain pre-training datasets or require substantial human labelling effort. To address these issues, we present a recent adaptive planning framework for efficient training data collection to substantially reduce human labelling requirements in semantic terrain monitoring missions. To this end, we combine high-quality human labels with automatically generated pseudo labels. Experimental results show that the framework reaches segmentation performance close to fully supervised approaches with drastically reduced human labelling effort while outperforming purely self-supervised approaches. We discuss the advantages and limitations of current methods and outline valuable future research avenues towards more robust and flexible robotic vision systems in unknown environments.
title Active Learning of Robot Vision Using Adaptive Path Planning
topic Robotics
url https://arxiv.org/abs/2410.10684