PGAD: Prototype-Guided Adaptive Distillation for Multi-Modal Learning in AD Diagnosis

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Yanfei, Yin, Teng, Shang, Wenyi, Liu, Jingyu, Wang, Xi, Zhao, Kaiyang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911123882639360
author Li, Yanfei
Yin, Teng
Shang, Wenyi
Liu, Jingyu
Wang, Xi
Zhao, Kaiyang
author_facet Li, Yanfei
Yin, Teng
Shang, Wenyi
Liu, Jingyu
Wang, Xi
Zhao, Kaiyang
contents Missing modalities pose a major issue in Alzheimer's Disease (AD) diagnosis, as many subjects lack full imaging data due to cost and clinical constraints. While multi-modal learning leverages complementary information, most existing methods train only on complete data, ignoring the large proportion of incomplete samples in real-world datasets like ADNI. This reduces the effective training set and limits the full use of valuable medical data. While some methods incorporate incomplete samples, they fail to effectively address inter-modal feature alignment and knowledge transfer challenges under high missing rates. To address this, we propose a Prototype-Guided Adaptive Distillation (PGAD) framework that directly incorporates incomplete multi-modal data into training. PGAD enhances missing modality representations through prototype matching and balances learning with a dynamic sampling strategy. We validate PGAD on the ADNI dataset with varying missing rates (20%, 50%, and 70%) and demonstrate that it significantly outperforms state-of-the-art approaches. Ablation studies confirm the effectiveness of prototype matching and adaptive sampling, highlighting the potential of our framework for robust and scalable AD diagnosis in real-world clinical settings.
format Preprint
id arxiv_https___arxiv_org_abs_2503_04836
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PGAD: Prototype-Guided Adaptive Distillation for Multi-Modal Learning in AD Diagnosis
Li, Yanfei
Yin, Teng
Shang, Wenyi
Liu, Jingyu
Wang, Xi
Zhao, Kaiyang
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Missing modalities pose a major issue in Alzheimer's Disease (AD) diagnosis, as many subjects lack full imaging data due to cost and clinical constraints. While multi-modal learning leverages complementary information, most existing methods train only on complete data, ignoring the large proportion of incomplete samples in real-world datasets like ADNI. This reduces the effective training set and limits the full use of valuable medical data. While some methods incorporate incomplete samples, they fail to effectively address inter-modal feature alignment and knowledge transfer challenges under high missing rates. To address this, we propose a Prototype-Guided Adaptive Distillation (PGAD) framework that directly incorporates incomplete multi-modal data into training. PGAD enhances missing modality representations through prototype matching and balances learning with a dynamic sampling strategy. We validate PGAD on the ADNI dataset with varying missing rates (20%, 50%, and 70%) and demonstrate that it significantly outperforms state-of-the-art approaches. Ablation studies confirm the effectiveness of prototype matching and adaptive sampling, highlighting the potential of our framework for robust and scalable AD diagnosis in real-world clinical settings.
title PGAD: Prototype-Guided Adaptive Distillation for Multi-Modal Learning in AD Diagnosis
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.04836