Adaptive Knowledge Transferring with Switching Dual-Student Framework for Semi-Supervised Medical Image Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nguyen, Hoang-Thien, Nguyen, Thanh-Huy, Lam, Ba-Thinh, Vu, Vi, Nguyen, Bach X., Xing, Jianhua, Wang, Tianyang, Li, Xingjian, Xu, Min
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917246612275200
author Nguyen, Hoang-Thien
Nguyen, Thanh-Huy
Lam, Ba-Thinh
Vu, Vi
Nguyen, Bach X.
Xing, Jianhua
Wang, Tianyang
Li, Xingjian
Xu, Min
author_facet Nguyen, Hoang-Thien
Nguyen, Thanh-Huy
Lam, Ba-Thinh
Vu, Vi
Nguyen, Bach X.
Xing, Jianhua
Wang, Tianyang
Li, Xingjian
Xu, Min
contents Teacher-student frameworks have emerged as a leading approach in semi-supervised medical image segmentation, demonstrating strong performance across various tasks. However, the learning effects are still limited by the strong correlation and unreliable knowledge transfer process between teacher and student networks. To overcome this limitation, we introduce a novel switching Dual-Student architecture that strategically selects the most reliable student at each iteration to enhance dual-student collaboration and prevent error reinforcement. We also introduce a strategy of Loss-Aware Exponential Moving Average to dynamically ensure that the teacher absorbs meaningful information from students, improving the quality of pseudo-labels. Our plug-and-play framework is extensively evaluated on 3D medical image segmentation datasets, where it outperforms state-of-the-art semi-supervised methods, demonstrating its effectiveness in improving segmentation accuracy under limited supervision.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24366
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Adaptive Knowledge Transferring with Switching Dual-Student Framework for Semi-Supervised Medical Image Segmentation
Nguyen, Hoang-Thien
Nguyen, Thanh-Huy
Lam, Ba-Thinh
Vu, Vi
Nguyen, Bach X.
Xing, Jianhua
Wang, Tianyang
Li, Xingjian
Xu, Min
Computer Vision and Pattern Recognition
Teacher-student frameworks have emerged as a leading approach in semi-supervised medical image segmentation, demonstrating strong performance across various tasks. However, the learning effects are still limited by the strong correlation and unreliable knowledge transfer process between teacher and student networks. To overcome this limitation, we introduce a novel switching Dual-Student architecture that strategically selects the most reliable student at each iteration to enhance dual-student collaboration and prevent error reinforcement. We also introduce a strategy of Loss-Aware Exponential Moving Average to dynamically ensure that the teacher absorbs meaningful information from students, improving the quality of pseudo-labels. Our plug-and-play framework is extensively evaluated on 3D medical image segmentation datasets, where it outperforms state-of-the-art semi-supervised methods, demonstrating its effectiveness in improving segmentation accuracy under limited supervision.
title Adaptive Knowledge Transferring with Switching Dual-Student Framework for Semi-Supervised Medical Image Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.24366