Bayesian Active Learning for Semantic Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Didari, Sima, Hu, Wenjun, Woo, Jae Oh, Hao, Heng, Moon, Hankyu, Min, Seungjai
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929449153331200
author Didari, Sima
Hu, Wenjun
Woo, Jae Oh
Hao, Heng
Moon, Hankyu
Min, Seungjai
author_facet Didari, Sima
Hu, Wenjun
Woo, Jae Oh
Hao, Heng
Moon, Hankyu
Min, Seungjai
contents Fully supervised training of semantic segmentation models is costly and challenging because each pixel within an image needs to be labeled. Therefore, the sparse pixel-level annotation methods have been introduced to train models with a subset of pixels within each image. We introduce a Bayesian active learning framework based on sparse pixel-level annotation that utilizes a pixel-level Bayesian uncertainty measure based on Balanced Entropy (BalEnt) [84]. BalEnt captures the information between the models' predicted marginalized probability distribution and the pixel labels. BalEnt has linear scalability with a closed analytical form and can be calculated independently per pixel without relational computations with other pixels. We train our proposed active learning framework for Cityscapes, Camvid, ADE20K and VOC2012 benchmark datasets and show that it reaches supervised levels of mIoU using only a fraction of labeled pixels while outperforming the previous state-of-the-art active learning models with a large margin.
format Preprint
id arxiv_https___arxiv_org_abs_2408_01694
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bayesian Active Learning for Semantic Segmentation
Didari, Sima
Hu, Wenjun
Woo, Jae Oh
Hao, Heng
Moon, Hankyu
Min, Seungjai
Computer Vision and Pattern Recognition
Fully supervised training of semantic segmentation models is costly and challenging because each pixel within an image needs to be labeled. Therefore, the sparse pixel-level annotation methods have been introduced to train models with a subset of pixels within each image. We introduce a Bayesian active learning framework based on sparse pixel-level annotation that utilizes a pixel-level Bayesian uncertainty measure based on Balanced Entropy (BalEnt) [84]. BalEnt captures the information between the models' predicted marginalized probability distribution and the pixel labels. BalEnt has linear scalability with a closed analytical form and can be calculated independently per pixel without relational computations with other pixels. We train our proposed active learning framework for Cityscapes, Camvid, ADE20K and VOC2012 benchmark datasets and show that it reaches supervised levels of mIoU using only a fraction of labeled pixels while outperforming the previous state-of-the-art active learning models with a large margin.
title Bayesian Active Learning for Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.01694