SegAssess: Panoramic quality mapping for robust and transferable unsupervised segmentation assessment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Bingnan, Zhang, Mi, Zhang, Zhili, Zhang, Zhan, Zhao, Yuanxin, Hu, Xiangyun, Gong, Jianya
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917181984342016
author Yang, Bingnan
Zhang, Mi
Zhang, Zhili
Zhang, Zhan
Zhao, Yuanxin
Hu, Xiangyun
Gong, Jianya
author_facet Yang, Bingnan
Zhang, Mi
Zhang, Zhili
Zhang, Zhan
Zhao, Yuanxin
Hu, Xiangyun
Gong, Jianya
contents High-quality image segmentation is fundamental to pixel-level geospatial analysis in remote sensing, necessitating robust segmentation quality assessment (SQA), particularly in unsupervised settings lacking ground truth. Although recent deep learning (DL) based unsupervised SQA methods show potential, they often suffer from coarse evaluation granularity, incomplete assessments, and poor transferability. To overcome these limitations, this paper introduces Panoramic Quality Mapping (PQM) as a new paradigm for comprehensive, pixel-wise SQA, and presents SegAssess, a novel deep learning framework realizing this approach. SegAssess distinctively formulates SQA as a fine-grained, four-class panoramic segmentation task, classifying pixels within a segmentation mask under evaluation into true positive (TP), false positive (FP), true negative (TN), and false negative (FN) categories, thereby generating a complete quality map. Leveraging an enhanced Segment Anything Model (SAM) architecture, SegAssess uniquely employs the input mask as a prompt for effective feature integration via cross-attention. Key innovations include an Edge Guided Compaction (EGC) branch with an Aggregated Semantic Filter (ASF) module to refine predictions near challenging object edges, and an Augmented Mixup Sampling (AMS) training strategy integrating multi-source masks to significantly boost cross-domain robustness and zero-shot transferability. Comprehensive experiments demonstrate that SegAssess achieves state-of-the-art (SOTA) performance and exhibits remarkable zero-shot transferability to unseen masks. The code is available at https://github.com/Yangbn97/SegAssess.
format Preprint
id arxiv_https___arxiv_org_abs_2509_01183
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SegAssess: Panoramic quality mapping for robust and transferable unsupervised segmentation assessment
Yang, Bingnan
Zhang, Mi
Zhang, Zhili
Zhang, Zhan
Zhao, Yuanxin
Hu, Xiangyun
Gong, Jianya
Computer Vision and Pattern Recognition
High-quality image segmentation is fundamental to pixel-level geospatial analysis in remote sensing, necessitating robust segmentation quality assessment (SQA), particularly in unsupervised settings lacking ground truth. Although recent deep learning (DL) based unsupervised SQA methods show potential, they often suffer from coarse evaluation granularity, incomplete assessments, and poor transferability. To overcome these limitations, this paper introduces Panoramic Quality Mapping (PQM) as a new paradigm for comprehensive, pixel-wise SQA, and presents SegAssess, a novel deep learning framework realizing this approach. SegAssess distinctively formulates SQA as a fine-grained, four-class panoramic segmentation task, classifying pixels within a segmentation mask under evaluation into true positive (TP), false positive (FP), true negative (TN), and false negative (FN) categories, thereby generating a complete quality map. Leveraging an enhanced Segment Anything Model (SAM) architecture, SegAssess uniquely employs the input mask as a prompt for effective feature integration via cross-attention. Key innovations include an Edge Guided Compaction (EGC) branch with an Aggregated Semantic Filter (ASF) module to refine predictions near challenging object edges, and an Augmented Mixup Sampling (AMS) training strategy integrating multi-source masks to significantly boost cross-domain robustness and zero-shot transferability. Comprehensive experiments demonstrate that SegAssess achieves state-of-the-art (SOTA) performance and exhibits remarkable zero-shot transferability to unseen masks. The code is available at https://github.com/Yangbn97/SegAssess.
title SegAssess: Panoramic quality mapping for robust and transferable unsupervised segmentation assessment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.01183