Object-level Correlation for Few-Shot Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wen, Chunlin, Zhang, Yu, Fan, Jie, Zhu, Hongyuan, Wei, Xiu-Shen, Wang, Yijun, Kou, Zhiqiang, Sun, Shuzhou
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908527979659264
author Wen, Chunlin
Zhang, Yu
Fan, Jie
Zhu, Hongyuan
Wei, Xiu-Shen
Wang, Yijun
Kou, Zhiqiang
Sun, Shuzhou
author_facet Wen, Chunlin
Zhang, Yu
Fan, Jie
Zhu, Hongyuan
Wei, Xiu-Shen
Wang, Yijun
Kou, Zhiqiang
Sun, Shuzhou
contents Few-shot semantic segmentation (FSS) aims to segment objects of novel categories in the query images given only a few annotated support samples. Existing methods primarily build the image-level correlation between the support target object and the entire query image. However, this correlation contains the hard pixel noise, \textit{i.e.}, irrelevant background objects, that is intractable to trace and suppress, leading to the overfitting of the background. To address the limitation of this correlation, we imitate the biological vision process to identify novel objects in the object-level information. Target identification in the general objects is more valid than in the entire image, especially in the low-data regime. Inspired by this, we design an Object-level Correlation Network (OCNet) by establishing the object-level correlation between the support target object and query general objects, which is mainly composed of the General Object Mining Module (GOMM) and Correlation Construction Module (CCM). Specifically, GOMM constructs the query general object feature by learning saliency and high-level similarity cues, where the general objects include the irrelevant background objects and the target foreground object. Then, CCM establishes the object-level correlation by allocating the target prototypes to match the general object feature. The generated object-level correlation can mine the query target feature and suppress the hard pixel noise for the final prediction. Extensive experiments on PASCAL-${5}^{i}$ and COCO-${20}^{i}$ show that our model achieves the state-of-the-art performance.
format Preprint
id arxiv_https___arxiv_org_abs_2509_07917
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Object-level Correlation for Few-Shot Segmentation
Wen, Chunlin
Zhang, Yu
Fan, Jie
Zhu, Hongyuan
Wei, Xiu-Shen
Wang, Yijun
Kou, Zhiqiang
Sun, Shuzhou
Computer Vision and Pattern Recognition
Few-shot semantic segmentation (FSS) aims to segment objects of novel categories in the query images given only a few annotated support samples. Existing methods primarily build the image-level correlation between the support target object and the entire query image. However, this correlation contains the hard pixel noise, \textit{i.e.}, irrelevant background objects, that is intractable to trace and suppress, leading to the overfitting of the background. To address the limitation of this correlation, we imitate the biological vision process to identify novel objects in the object-level information. Target identification in the general objects is more valid than in the entire image, especially in the low-data regime. Inspired by this, we design an Object-level Correlation Network (OCNet) by establishing the object-level correlation between the support target object and query general objects, which is mainly composed of the General Object Mining Module (GOMM) and Correlation Construction Module (CCM). Specifically, GOMM constructs the query general object feature by learning saliency and high-level similarity cues, where the general objects include the irrelevant background objects and the target foreground object. Then, CCM establishes the object-level correlation by allocating the target prototypes to match the general object feature. The generated object-level correlation can mine the query target feature and suppress the hard pixel noise for the final prediction. Extensive experiments on PASCAL-${5}^{i}$ and COCO-${20}^{i}$ show that our model achieves the state-of-the-art performance.
title Object-level Correlation for Few-Shot Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.07917