Multi-Prototype Embedding Refinement for Semi-Supervised Medical Image Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bi, Yali, Che, Enyu, Chen, Yinan, He, Yuanpeng, Qu, Jingwei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908273642307584
author Bi, Yali
Che, Enyu
Chen, Yinan
He, Yuanpeng
Qu, Jingwei
author_facet Bi, Yali
Che, Enyu
Chen, Yinan
He, Yuanpeng
Qu, Jingwei
contents Medical image segmentation aims to identify anatomical structures at the voxel-level. Segmentation accuracy relies on distinguishing voxel differences. Compared to advancements achieved in studies of the inter-class variance, the intra-class variance receives less attention. Moreover, traditional linear classifiers, limited by a single learnable weight per class, struggle to capture this finer distinction. To address the above challenges, we propose a Multi-Prototype-based Embedding Refinement method for semi-supervised medical image segmentation. Specifically, we design a multi-prototype-based classification strategy, rethinking the segmentation from the perspective of structural relationships between voxel embeddings. The intra-class variations are explored by clustering voxels along the distribution of multiple prototypes in each class. Next, we introduce a consistency constraint to alleviate the limitation of linear classifiers. This constraint integrates different classification granularities from a linear classifier and the proposed prototype-based classifier. In the thorough evaluation on two popular benchmarks, our method achieves superior performance compared with state-of-the-art methods. Code is available at https://github.com/Briley-byl123/MPER.
format Preprint
id arxiv_https___arxiv_org_abs_2503_14343
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Prototype Embedding Refinement for Semi-Supervised Medical Image Segmentation
Bi, Yali
Che, Enyu
Chen, Yinan
He, Yuanpeng
Qu, Jingwei
Image and Video Processing
Computer Vision and Pattern Recognition
Medical image segmentation aims to identify anatomical structures at the voxel-level. Segmentation accuracy relies on distinguishing voxel differences. Compared to advancements achieved in studies of the inter-class variance, the intra-class variance receives less attention. Moreover, traditional linear classifiers, limited by a single learnable weight per class, struggle to capture this finer distinction. To address the above challenges, we propose a Multi-Prototype-based Embedding Refinement method for semi-supervised medical image segmentation. Specifically, we design a multi-prototype-based classification strategy, rethinking the segmentation from the perspective of structural relationships between voxel embeddings. The intra-class variations are explored by clustering voxels along the distribution of multiple prototypes in each class. Next, we introduce a consistency constraint to alleviate the limitation of linear classifiers. This constraint integrates different classification granularities from a linear classifier and the proposed prototype-based classifier. In the thorough evaluation on two popular benchmarks, our method achieves superior performance compared with state-of-the-art methods. Code is available at https://github.com/Briley-byl123/MPER.
title Multi-Prototype Embedding Refinement for Semi-Supervised Medical Image Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.14343