Improving 3D Few-Shot Segmentation with Inference-Time Pseudo-Labeling

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mozafari, Mohammad, Hasani, Hosein, Vahidimajd, Reza, Fereydooni, Mohamadreza, Baghshah, Mahdieh Soleymani
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909347559243776
author Mozafari, Mohammad
Hasani, Hosein
Vahidimajd, Reza
Fereydooni, Mohamadreza
Baghshah, Mahdieh Soleymani
author_facet Mozafari, Mohammad
Hasani, Hosein
Vahidimajd, Reza
Fereydooni, Mohamadreza
Baghshah, Mahdieh Soleymani
contents In recent years, few-shot segmentation (FSS) models have emerged as a promising approach in medical imaging analysis, offering remarkable adaptability to segment novel classes with limited annotated data. Existing approaches to few-shot segmentation have often overlooked the potential of the query itself, failing to fully utilize the valuable information it contains. However, treating the query as unlabeled data provides an opportunity to enhance prediction accuracy. Specifically in the domain of medical imaging, the volumetric structure of queries offers a considerable source of valuable information that can be used to improve the target slice segmentation. In this work, we present a novel strategy to efficiently leverage the intrinsic information of the query sample for final segmentation during inference. First, we use the support slices from a reference volume to generate an initial segmentation score for the query slices through a prototypical approach. Subsequently, we apply a confidence-aware pseudo-labeling procedure to transfer the most informative parts of query slices to the support set. The final prediction is performed based on the new expanded support set, enabling the prediction of a more accurate segmentation mask for the query volume. Extensive experiments show that the proposed method can effectively boost performance across diverse settings and datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09967
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving 3D Few-Shot Segmentation with Inference-Time Pseudo-Labeling
Mozafari, Mohammad
Hasani, Hosein
Vahidimajd, Reza
Fereydooni, Mohamadreza
Baghshah, Mahdieh Soleymani
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
In recent years, few-shot segmentation (FSS) models have emerged as a promising approach in medical imaging analysis, offering remarkable adaptability to segment novel classes with limited annotated data. Existing approaches to few-shot segmentation have often overlooked the potential of the query itself, failing to fully utilize the valuable information it contains. However, treating the query as unlabeled data provides an opportunity to enhance prediction accuracy. Specifically in the domain of medical imaging, the volumetric structure of queries offers a considerable source of valuable information that can be used to improve the target slice segmentation. In this work, we present a novel strategy to efficiently leverage the intrinsic information of the query sample for final segmentation during inference. First, we use the support slices from a reference volume to generate an initial segmentation score for the query slices through a prototypical approach. Subsequently, we apply a confidence-aware pseudo-labeling procedure to transfer the most informative parts of query slices to the support set. The final prediction is performed based on the new expanded support set, enabling the prediction of a more accurate segmentation mask for the query volume. Extensive experiments show that the proposed method can effectively boost performance across diverse settings and datasets.
title Improving 3D Few-Shot Segmentation with Inference-Time Pseudo-Labeling
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2410.09967