Query-aware Hub Prototype Learning for Few-Shot 3D Point Cloud Semantic Segmentation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhou, YiLin, Wei, Lili, Xu, Zheming, Chen, Ziyi, Lang, Congyan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915662340816896
author Zhou, YiLin
Wei, Lili
Xu, Zheming
Chen, Ziyi
Lang, Congyan
author_facet Zhou, YiLin
Wei, Lili
Xu, Zheming
Chen, Ziyi
Lang, Congyan
contents Few-shot 3D point cloud semantic segmentation (FS-3DSeg) aims to segment novel classes with only a few labeled samples. However, existing metric-based prototype learning methods generate prototypes solely from the support set, without considering their relevance to query data. This often results in prototype bias, where prototypes overfit support-specific characteristics and fail to generalize to the query distribution, especially in the presence of distribution shifts, which leads to degraded segmentation performance. To address this issue, we propose a novel Query-aware Hub Prototype (QHP) learning method that explicitly models semantic correlations between support and query sets. Specifically, we propose a Hub Prototype Generation (HPG) module that constructs a bipartite graph connecting query and support points, identifies frequently linked support hubs, and generates query-relevant prototypes that better capture cross-set semantics. To further mitigate the influence of bad hubs and ambiguous prototypes near class boundaries, we introduce a Prototype Distribution Optimization (PDO) module, which employs a purity-reweighted contrastive loss to refine prototype representations by pulling bad hubs and outlier prototypes closer to their corresponding class centers. Extensive experiments on S3DIS and ScanNet demonstrate that QHP achieves substantial performance gains over state-of-the-art methods, effectively narrowing the semantic gap between prototypes and query sets in FS-3DSeg.
format Preprint
id arxiv_https___arxiv_org_abs_2512_08253
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Query-aware Hub Prototype Learning for Few-Shot 3D Point Cloud Semantic Segmentation
Zhou, YiLin
Wei, Lili
Xu, Zheming
Chen, Ziyi
Lang, Congyan
Computer Vision and Pattern Recognition
Few-shot 3D point cloud semantic segmentation (FS-3DSeg) aims to segment novel classes with only a few labeled samples. However, existing metric-based prototype learning methods generate prototypes solely from the support set, without considering their relevance to query data. This often results in prototype bias, where prototypes overfit support-specific characteristics and fail to generalize to the query distribution, especially in the presence of distribution shifts, which leads to degraded segmentation performance. To address this issue, we propose a novel Query-aware Hub Prototype (QHP) learning method that explicitly models semantic correlations between support and query sets. Specifically, we propose a Hub Prototype Generation (HPG) module that constructs a bipartite graph connecting query and support points, identifies frequently linked support hubs, and generates query-relevant prototypes that better capture cross-set semantics. To further mitigate the influence of bad hubs and ambiguous prototypes near class boundaries, we introduce a Prototype Distribution Optimization (PDO) module, which employs a purity-reweighted contrastive loss to refine prototype representations by pulling bad hubs and outlier prototypes closer to their corresponding class centers. Extensive experiments on S3DIS and ScanNet demonstrate that QHP achieves substantial performance gains over state-of-the-art methods, effectively narrowing the semantic gap between prototypes and query sets in FS-3DSeg.
title Query-aware Hub Prototype Learning for Few-Shot 3D Point Cloud Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.08253