Bridging the Gap in Missing Modalities: Leveraging Knowledge Distillation and Style Matching for Brain Tumor Segmentation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhu, Shenghao, Chen, Yifei, Chen, Weihong, Wang, Yuanhan, Liu, Chang, Jiang, Shuo, Qin, Feiwei, Wang, Changmiao
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913966168473600
author Zhu, Shenghao
Chen, Yifei
Chen, Weihong
Wang, Yuanhan
Liu, Chang
Jiang, Shuo
Qin, Feiwei
Wang, Changmiao
author_facet Zhu, Shenghao
Chen, Yifei
Chen, Weihong
Wang, Yuanhan
Liu, Chang
Jiang, Shuo
Qin, Feiwei
Wang, Changmiao
contents Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary segmentation insensitivity and feature transfer in the absence of key imaging modalities. In this study, we introduce MST-KDNet, aimed at addressing these critical issues. Our model features Multi-Scale Transformer Knowledge Distillation to effectively capture attention weights at various resolutions, Dual-Mode Logit Distillation to improve the transfer of knowledge, and a Global Style Matching Module that integrates feature matching with adversarial learning. Comprehensive experiments conducted on the BraTS and FeTS 2024 datasets demonstrate that MST-KDNet surpasses current leading methods in both Dice and HD95 scores, particularly in conditions with substantial modality loss. Our approach shows exceptional robustness and generalization potential, making it a promising candidate for real-world clinical applications. Our source code is available at https://github.com/Quanato607/MST-KDNet.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22626
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging the Gap in Missing Modalities: Leveraging Knowledge Distillation and Style Matching for Brain Tumor Segmentation
Zhu, Shenghao
Chen, Yifei
Chen, Weihong
Wang, Yuanhan
Liu, Chang
Jiang, Shuo
Qin, Feiwei
Wang, Changmiao
Computer Vision and Pattern Recognition
Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary segmentation insensitivity and feature transfer in the absence of key imaging modalities. In this study, we introduce MST-KDNet, aimed at addressing these critical issues. Our model features Multi-Scale Transformer Knowledge Distillation to effectively capture attention weights at various resolutions, Dual-Mode Logit Distillation to improve the transfer of knowledge, and a Global Style Matching Module that integrates feature matching with adversarial learning. Comprehensive experiments conducted on the BraTS and FeTS 2024 datasets demonstrate that MST-KDNet surpasses current leading methods in both Dice and HD95 scores, particularly in conditions with substantial modality loss. Our approach shows exceptional robustness and generalization potential, making it a promising candidate for real-world clinical applications. Our source code is available at https://github.com/Quanato607/MST-KDNet.
title Bridging the Gap in Missing Modalities: Leveraging Knowledge Distillation and Style Matching for Brain Tumor Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.22626