SimCS: Simulation for Domain Incremental Online Continual Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Alfarra, Motasem, Cai, Zhipeng, Bibi, Adel, Ghanem, Bernard, Müller, Matthias
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916125350035456
author Alfarra, Motasem
Cai, Zhipeng
Bibi, Adel
Ghanem, Bernard
Müller, Matthias
author_facet Alfarra, Motasem
Cai, Zhipeng
Bibi, Adel
Ghanem, Bernard
Müller, Matthias
contents Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image classification in the class-incremental setup with clear task boundaries and unlimited computational budget. This work explores the problem of Online Domain-Incremental Continual Segmentation (ODICS), where the model is continually trained over batches of densely labeled images from different domains, with limited computation and no information about the task boundaries. ODICS arises in many practical applications. In autonomous driving, this may correspond to the realistic scenario of training a segmentation model over time on a sequence of cities. We analyze several existing continual learning methods and show that they perform poorly in this setting despite working well in class-incremental segmentation. We propose SimCS, a parameter-free method complementary to existing ones that uses simulated data to regularize continual learning. Experiments show that SimCS provides consistent improvements when combined with different CL methods.
format Preprint
id arxiv_https___arxiv_org_abs_2211_16234
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle SimCS: Simulation for Domain Incremental Online Continual Segmentation
Alfarra, Motasem
Cai, Zhipeng
Bibi, Adel
Ghanem, Bernard
Müller, Matthias
Computer Vision and Pattern Recognition
Machine Learning
Continual Learning is a step towards lifelong intelligence where models continuously learn from recently collected data without forgetting previous knowledge. Existing continual learning approaches mostly focus on image classification in the class-incremental setup with clear task boundaries and unlimited computational budget. This work explores the problem of Online Domain-Incremental Continual Segmentation (ODICS), where the model is continually trained over batches of densely labeled images from different domains, with limited computation and no information about the task boundaries. ODICS arises in many practical applications. In autonomous driving, this may correspond to the realistic scenario of training a segmentation model over time on a sequence of cities. We analyze several existing continual learning methods and show that they perform poorly in this setting despite working well in class-incremental segmentation. We propose SimCS, a parameter-free method complementary to existing ones that uses simulated data to regularize continual learning. Experiments show that SimCS provides consistent improvements when combined with different CL methods.
title SimCS: Simulation for Domain Incremental Online Continual Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2211.16234