Guardado en:
Detalles Bibliográficos
Autores principales: Fan, Xingye, Zhongwen, Zhang, Boykov, Yuri
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2503.06954
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916648094531584
author Fan, Xingye
Zhongwen
Zhang
Boykov, Yuri
author_facet Fan, Xingye
Zhongwen
Zhang
Boykov, Yuri
contents This paper demonstrates a surprising result for segmentation with image-level targets: extending binary class tags to approximate relative object-size distributions allows off-the-shelf architectures to solve the segmentation problem. A straightforward zero-avoiding KL-divergence loss for average predictions produces segmentation accuracy comparable to the standard pixel-precise supervision with full ground truth masks. In contrast, current results based on class tags typically require complex non-reproducible architectural modifications and specialized multi-stage training procedures. Our ideas are validated on PASCAL VOC using our new human annotations of approximate object sizes. We also show the results on COCO and medical data using synthetically corrupted size targets. All standard networks demonstrate robustness to the size targets' errors. For some classes, the validation accuracy is significantly better than the pixel-level supervision; the latter is not robust to errors in the masks. Our work provides new ideas and insights on image-level supervision in segmentation and may encourage other simple general solutions to the problem.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06954
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation
Fan, Xingye
Zhongwen
Zhang
Boykov, Yuri
Computer Vision and Pattern Recognition
This paper demonstrates a surprising result for segmentation with image-level targets: extending binary class tags to approximate relative object-size distributions allows off-the-shelf architectures to solve the segmentation problem. A straightforward zero-avoiding KL-divergence loss for average predictions produces segmentation accuracy comparable to the standard pixel-precise supervision with full ground truth masks. In contrast, current results based on class tags typically require complex non-reproducible architectural modifications and specialized multi-stage training procedures. Our ideas are validated on PASCAL VOC using our new human annotations of approximate object sizes. We also show the results on COCO and medical data using synthetically corrupted size targets. All standard networks demonstrate robustness to the size targets' errors. For some classes, the validation accuracy is significantly better than the pixel-level supervision; the latter is not robust to errors in the masks. Our work provides new ideas and insights on image-level supervision in segmentation and may encourage other simple general solutions to the problem.
title Approximate Size Targets Are Sufficient for Accurate Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.06954