Advancing Medical Image Segmentation via Self-supervised Instance-adaptive Prototype Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liang, Guoyan, Zhou, Qin, Chen, Jingyuan, Wang, Zhe, Yao, Chang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913936072245248
author Liang, Guoyan
Zhou, Qin
Chen, Jingyuan
Wang, Zhe
Yao, Chang
author_facet Liang, Guoyan
Zhou, Qin
Chen, Jingyuan
Wang, Zhe
Yao, Chang
contents Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current approaches often overlook sample diversity by using a fixed prototype per semantic class and neglect intra-class variation within each input. In this paper, we propose to generate instance-adaptive prototypes for MIS, which integrates a common prototype proposal (CPP) capturing common visual patterns and an instance-specific prototype proposal (IPP) tailored to each input. To further account for the intra-class variation, we propose to guide the IPP generation by re-weighting the intermediate feature map according to their confidence scores. These confidence scores are hierarchically generated using a transformer decoder. Additionally we introduce a novel self-supervised filtering strategy to prioritize the foreground pixels during the training of the transformer decoder. Extensive experiments demonstrate favorable performance of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2507_07602
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advancing Medical Image Segmentation via Self-supervised Instance-adaptive Prototype Learning
Liang, Guoyan
Zhou, Qin
Chen, Jingyuan
Wang, Zhe
Yao, Chang
Methodology
Image and Video Processing
Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current approaches often overlook sample diversity by using a fixed prototype per semantic class and neglect intra-class variation within each input. In this paper, we propose to generate instance-adaptive prototypes for MIS, which integrates a common prototype proposal (CPP) capturing common visual patterns and an instance-specific prototype proposal (IPP) tailored to each input. To further account for the intra-class variation, we propose to guide the IPP generation by re-weighting the intermediate feature map according to their confidence scores. These confidence scores are hierarchically generated using a transformer decoder. Additionally we introduce a novel self-supervised filtering strategy to prioritize the foreground pixels during the training of the transformer decoder. Extensive experiments demonstrate favorable performance of our method.
title Advancing Medical Image Segmentation via Self-supervised Instance-adaptive Prototype Learning
topic Methodology
Image and Video Processing
url https://arxiv.org/abs/2507.07602