Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Yifei, Zhu, Shenghao, Fang, Zhaojie, Liu, Chang, Zou, Binfeng, Wang, Yuhe, Chang, Shuo, Jia, Fan, Qin, Feiwei, Fan, Jin, Peng, Yong, Wang, Changmiao
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910771048349696
author Chen, Yifei
Zhu, Shenghao
Fang, Zhaojie
Liu, Chang
Zou, Binfeng
Wang, Yuhe
Chang, Shuo
Jia, Fan
Qin, Feiwei
Fan, Jin
Peng, Yong
Wang, Changmiao
author_facet Chen, Yifei
Zhu, Shenghao
Fang, Zhaojie
Liu, Chang
Zou, Binfeng
Wang, Yuhe
Chang, Shuo
Jia, Fan
Qin, Feiwei
Fan, Jin
Peng, Yong
Wang, Changmiao
contents Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to misdiagnosis with traditional unimodal diagnostic methods due to their limited scope. This study introduces an advanced multimodal classification model that integrates clinical, cognitive, neuroimaging, and EEG data to enhance diagnostic accuracy. The model incorporates a feature tagger with a tabular data coding architecture and utilizes the TimesBlock module to capture intricate temporal patterns in Electroencephalograms (EEG) data. By employing Cross-modal Attention Aggregation module, the model effectively fuses Magnetic Resonance Imaging (MRI) spatial information with EEG temporal data, significantly improving the distinction between AD, Mild Cognitive Impairment, and Normal Cognition. Simultaneously, we have constructed the first AD classification dataset that includes three modalities: EEG, MRI, and tabular data. Our innovative approach aims to facilitate early diagnosis and intervention, potentially slowing the progression of AD. The source code and our private ADMC dataset are available at https://github.com/JustlfC03/MSTNet.
format Preprint
id arxiv_https___arxiv_org_abs_2408_16343
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach
Chen, Yifei
Zhu, Shenghao
Fang, Zhaojie
Liu, Chang
Zou, Binfeng
Wang, Yuhe
Chang, Shuo
Jia, Fan
Qin, Feiwei
Fan, Jin
Peng, Yong
Wang, Changmiao
Computer Vision and Pattern Recognition
Artificial Intelligence
Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to misdiagnosis with traditional unimodal diagnostic methods due to their limited scope. This study introduces an advanced multimodal classification model that integrates clinical, cognitive, neuroimaging, and EEG data to enhance diagnostic accuracy. The model incorporates a feature tagger with a tabular data coding architecture and utilizes the TimesBlock module to capture intricate temporal patterns in Electroencephalograms (EEG) data. By employing Cross-modal Attention Aggregation module, the model effectively fuses Magnetic Resonance Imaging (MRI) spatial information with EEG temporal data, significantly improving the distinction between AD, Mild Cognitive Impairment, and Normal Cognition. Simultaneously, we have constructed the first AD classification dataset that includes three modalities: EEG, MRI, and tabular data. Our innovative approach aims to facilitate early diagnosis and intervention, potentially slowing the progression of AD. The source code and our private ADMC dataset are available at https://github.com/JustlfC03/MSTNet.
title Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2408.16343