Noisy Annotations in Semantic Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kimhi, Moshe, Kerem, Omer, Grad, Eden, Rivlin, Ehud, Baskin, Chaim
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910902175924224
author Kimhi, Moshe
Kerem, Omer
Grad, Eden
Rivlin, Ehud
Baskin, Chaim
author_facet Kimhi, Moshe
Kerem, Omer
Grad, Eden
Rivlin, Ehud
Baskin, Chaim
contents Obtaining accurate labels for instance segmentation is particularly challenging due to the complex nature of the task. Each image necessitates multiple annotations, encompassing not only the object class but also its precise spatial boundaries. These requirements elevate the likelihood of errors and inconsistencies in both manual and automated annotation processes. By simulating different noise conditions, we provide a realistic scenario for assessing the robustness and generalization capabilities of instance segmentation models in different segmentation tasks, introducing COCO-N and Cityscapes-N. We also propose a benchmark for weakly annotation noise, dubbed COCO-WAN, which utilizes foundation models and weak annotations to simulate semi-automated annotation tools and their noisy labels. This study sheds light on the quality of segmentation masks produced by various models and challenges the efficacy of popular methods designed to address learning with label noise.
format Preprint
id arxiv_https___arxiv_org_abs_2406_10891
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Noisy Annotations in Semantic Segmentation
Kimhi, Moshe
Kerem, Omer
Grad, Eden
Rivlin, Ehud
Baskin, Chaim
Computer Vision and Pattern Recognition
Machine Learning
Obtaining accurate labels for instance segmentation is particularly challenging due to the complex nature of the task. Each image necessitates multiple annotations, encompassing not only the object class but also its precise spatial boundaries. These requirements elevate the likelihood of errors and inconsistencies in both manual and automated annotation processes. By simulating different noise conditions, we provide a realistic scenario for assessing the robustness and generalization capabilities of instance segmentation models in different segmentation tasks, introducing COCO-N and Cityscapes-N. We also propose a benchmark for weakly annotation noise, dubbed COCO-WAN, which utilizes foundation models and weak annotations to simulate semi-automated annotation tools and their noisy labels. This study sheds light on the quality of segmentation masks produced by various models and challenges the efficacy of popular methods designed to address learning with label noise.
title Noisy Annotations in Semantic Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2406.10891