SSeg: Active Sparse Point-Label Augmentation for Semantic Segmentation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Borja, Cesar, Plou, Carlos, Martinez-Cantin, Ruben, Murillo, Ana C.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914426201833472
author Borja, Cesar
Plou, Carlos
Martinez-Cantin, Ruben
Murillo, Ana C.
author_facet Borja, Cesar
Plou, Carlos
Martinez-Cantin, Ruben
Murillo, Ana C.
contents Semantic segmentation is essential for automating remote sensing analysis in fields like ecology. However, fine-grained analysis of complex aerial or underwater imagery remains an open challenge, even for state-of-the-art models. Progress is frequently hindered by the high cost of obtaining the dense, expert-annotated labels required for model supervision. While sparse point-labels are easier to obtain, they introduce challenges regarding which points to annotate and how to propagate the sparse information. We present SSeg, a novel framework that addresses both issues. SSeg first employs an active sampling strategy to guide annotators, maximizing the value of their point labels. Then, it propagates these sparse labels with a hybrid approach leveraging both the best of SAM2 and superpixel-based methods. Experiments on two diverse monitoring datasets demonstrate SSeg's benefits over state-of-the-art approaches. Our main contribution is a simple but effective interactive annotation tool integrating our algorithms. It enables ecology researchers to leverage foundation models and computer vision to efficiently generate high-quality segmentation masks to process their data.
format Preprint
id arxiv_https___arxiv_org_abs_2510_10163
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SSeg: Active Sparse Point-Label Augmentation for Semantic Segmentation
Borja, Cesar
Plou, Carlos
Martinez-Cantin, Ruben
Murillo, Ana C.
Computer Vision and Pattern Recognition
Semantic segmentation is essential for automating remote sensing analysis in fields like ecology. However, fine-grained analysis of complex aerial or underwater imagery remains an open challenge, even for state-of-the-art models. Progress is frequently hindered by the high cost of obtaining the dense, expert-annotated labels required for model supervision. While sparse point-labels are easier to obtain, they introduce challenges regarding which points to annotate and how to propagate the sparse information. We present SSeg, a novel framework that addresses both issues. SSeg first employs an active sampling strategy to guide annotators, maximizing the value of their point labels. Then, it propagates these sparse labels with a hybrid approach leveraging both the best of SAM2 and superpixel-based methods. Experiments on two diverse monitoring datasets demonstrate SSeg's benefits over state-of-the-art approaches. Our main contribution is a simple but effective interactive annotation tool integrating our algorithms. It enables ecology researchers to leverage foundation models and computer vision to efficiently generate high-quality segmentation masks to process their data.
title SSeg: Active Sparse Point-Label Augmentation for Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.10163