Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Junyang, Lv, Xiangbo, Kou, Zhiqiang, Sheng, Xingdong, Xu, Ning, Qiao, Yiguo
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2602.05578
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908829746200576
author Chen, Junyang
Lv, Xiangbo
Kou, Zhiqiang
Sheng, Xingdong
Xu, Ning
Qiao, Yiguo
author_facet Chen, Junyang
Lv, Xiangbo
Kou, Zhiqiang
Sheng, Xingdong
Xu, Ning
Qiao, Yiguo
contents Open-vocabulary semantic segmentation (OVSS) extends traditional closed-set segmentation by enabling pixel-wise annotation for both seen and unseen categories using arbitrary textual descriptions. While existing methods leverage vision-language models (VLMs) like CLIP, their reliance on image-level pretraining often results in imprecise spatial alignment, leading to mismatched segmentations in ambiguous or cluttered scenes. However, most existing approaches lack strong object priors and region-level constraints, which can lead to object hallucination or missed detections, further degrading performance. To address these challenges, we propose LoGoSeg, an efficient single-stage framework that integrates three key innovations: (i) an object existence prior that dynamically weights relevant categories through global image-text similarity, effectively reducing hallucinations; (ii) a region-aware alignment module that establishes precise region-level visual-textual correspondences; and (iii) a dual-stream fusion mechanism that optimally combines local structural information with global semantic context. Unlike prior works, LoGoSeg eliminates the need for external mask proposals, additional backbones, or extra datasets, ensuring efficiency. Extensive experiments on six benchmarks (A-847, PC-459, A-150, PC-59, PAS-20, and PAS-20b) demonstrate its competitive performance and strong generalization in open-vocabulary settings.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05578
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LoGoSeg: Integrating Local and Global Features for Open-Vocabulary Semantic Segmentation
Chen, Junyang
Lv, Xiangbo
Kou, Zhiqiang
Sheng, Xingdong
Xu, Ning
Qiao, Yiguo
Computer Vision and Pattern Recognition
Open-vocabulary semantic segmentation (OVSS) extends traditional closed-set segmentation by enabling pixel-wise annotation for both seen and unseen categories using arbitrary textual descriptions. While existing methods leverage vision-language models (VLMs) like CLIP, their reliance on image-level pretraining often results in imprecise spatial alignment, leading to mismatched segmentations in ambiguous or cluttered scenes. However, most existing approaches lack strong object priors and region-level constraints, which can lead to object hallucination or missed detections, further degrading performance. To address these challenges, we propose LoGoSeg, an efficient single-stage framework that integrates three key innovations: (i) an object existence prior that dynamically weights relevant categories through global image-text similarity, effectively reducing hallucinations; (ii) a region-aware alignment module that establishes precise region-level visual-textual correspondences; and (iii) a dual-stream fusion mechanism that optimally combines local structural information with global semantic context. Unlike prior works, LoGoSeg eliminates the need for external mask proposals, additional backbones, or extra datasets, ensuring efficiency. Extensive experiments on six benchmarks (A-847, PC-459, A-150, PC-59, PAS-20, and PAS-20b) demonstrate its competitive performance and strong generalization in open-vocabulary settings.
title LoGoSeg: Integrating Local and Global Features for Open-Vocabulary Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.05578