Multi-Task Learning for Robot Perception with Imbalanced Data

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Erkent, Ozgur
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908805260902400
author Erkent, Ozgur
author_facet Erkent, Ozgur
contents Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely imbalanced data exist, a problem may arise due to insufficient number of samples, and labeling is not very easy for mobile robots in every environment. We propose a method that can learn tasks even in the absence of the ground truth labels for some of the tasks. We also provide a detailed analysis of the proposed method. An interesting finding is related to the interaction of the tasks. We show a methodology to find out which tasks can improve the performance of other tasks. We investigate this by training the teacher network with the task outputs such as depth as inputs. We further provide empirical evidence when trained with a small amount of data. We use semantic segmentation and depth estimation tasks on different datasets, NYUDv2 and Cityscapes.
format Preprint
id arxiv_https___arxiv_org_abs_2602_01899
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multi-Task Learning for Robot Perception with Imbalanced Data
Erkent, Ozgur
Robotics
Computer Vision and Pattern Recognition
Multi-task problem solving has been shown to improve the accuracy of the individual tasks, which is an important feature for robots, as they have a limited resource. However, when the number of labels for each task is not equal, namely imbalanced data exist, a problem may arise due to insufficient number of samples, and labeling is not very easy for mobile robots in every environment. We propose a method that can learn tasks even in the absence of the ground truth labels for some of the tasks. We also provide a detailed analysis of the proposed method. An interesting finding is related to the interaction of the tasks. We show a methodology to find out which tasks can improve the performance of other tasks. We investigate this by training the teacher network with the task outputs such as depth as inputs. We further provide empirical evidence when trained with a small amount of data. We use semantic segmentation and depth estimation tasks on different datasets, NYUDv2 and Cityscapes.
title Multi-Task Learning for Robot Perception with Imbalanced Data
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.01899