SAMST: A Transformer framework based on SAM pseudo label filtering for remote sensing semi-supervised semantic segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yin, Jun, Wu, Fei, Ren, Yupeng, Huang, Jisheng, Li, Qiankun, jin, Heng, Fu, Jianhai, Cui, Chanjie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916846044708864
author Yin, Jun
Wu, Fei
Ren, Yupeng
Huang, Jisheng
Li, Qiankun
jin, Heng
Fu, Jianhai
Cui, Chanjie
author_facet Yin, Jun
Wu, Fei
Ren, Yupeng
Huang, Jisheng
Li, Qiankun
jin, Heng
Fu, Jianhai
Cui, Chanjie
contents Public remote sensing datasets often face limitations in universality due to resolution variability and inconsistent land cover category definitions. To harness the vast pool of unlabeled remote sensing data, we propose SAMST, a semi-supervised semantic segmentation method. SAMST leverages the strengths of the Segment Anything Model (SAM) in zero-shot generalization and boundary detection. SAMST iteratively refines pseudo-labels through two main components: supervised model self-training using both labeled and pseudo-labeled data, and a SAM-based Pseudo-label Refiner. The Pseudo-label Refiner comprises three modules: a Threshold Filter Module for preprocessing, a Prompt Generation Module for extracting connected regions and generating prompts for SAM, and a Label Refinement Module for final label stitching. By integrating the generalization power of large models with the training efficiency of small models, SAMST improves pseudo-label accuracy, thereby enhancing overall model performance. Experiments on the Potsdam dataset validate the effectiveness and feasibility of SAMST, demonstrating its potential to address the challenges posed by limited labeled data in remote sensing semantic segmentation.
format Preprint
id arxiv_https___arxiv_org_abs_2507_11994
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SAMST: A Transformer framework based on SAM pseudo label filtering for remote sensing semi-supervised semantic segmentation
Yin, Jun
Wu, Fei
Ren, Yupeng
Huang, Jisheng
Li, Qiankun
jin, Heng
Fu, Jianhai
Cui, Chanjie
Computer Vision and Pattern Recognition
Public remote sensing datasets often face limitations in universality due to resolution variability and inconsistent land cover category definitions. To harness the vast pool of unlabeled remote sensing data, we propose SAMST, a semi-supervised semantic segmentation method. SAMST leverages the strengths of the Segment Anything Model (SAM) in zero-shot generalization and boundary detection. SAMST iteratively refines pseudo-labels through two main components: supervised model self-training using both labeled and pseudo-labeled data, and a SAM-based Pseudo-label Refiner. The Pseudo-label Refiner comprises three modules: a Threshold Filter Module for preprocessing, a Prompt Generation Module for extracting connected regions and generating prompts for SAM, and a Label Refinement Module for final label stitching. By integrating the generalization power of large models with the training efficiency of small models, SAMST improves pseudo-label accuracy, thereby enhancing overall model performance. Experiments on the Potsdam dataset validate the effectiveness and feasibility of SAMST, demonstrating its potential to address the challenges posed by limited labeled data in remote sensing semantic segmentation.
title SAMST: A Transformer framework based on SAM pseudo label filtering for remote sensing semi-supervised semantic segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.11994