Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sharshar, Ahmed, Ashraf, Yasser, Bakr, Tameem, Hassan, Salma, Elgendy, Hosam, Yaqub, Mohammad, Guizani, Mohsen
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909709236174848
author Sharshar, Ahmed
Ashraf, Yasser
Bakr, Tameem
Hassan, Salma
Elgendy, Hosam
Yaqub, Mohammad
Guizani, Mohsen
author_facet Sharshar, Ahmed
Ashraf, Yasser
Bakr, Tameem
Hassan, Salma
Elgendy, Hosam
Yaqub, Mohammad
Guizani, Mohsen
contents Alzheimer's disease affects over 55 million people worldwide and is projected to more than double by 2050, necessitating rapid, accurate, and scalable diagnostics. However, existing approaches are limited because they cannot achieve clinically acceptable accuracy, generalization across datasets, robustness to missing modalities, and explainability all at the same time. This inability to satisfy all these requirements simultaneously undermines their reliability in clinical settings. We propose OmniBrain, a multimodal framework that integrates brain MRI, radiomics, gene expression, and clinical data using a unified model with cross-attention and modality dropout. OmniBrain achieves $92.2 \pm 2.4\%$accuracy on the ANMerge dataset and generalizes to the MRI-only ADNI dataset with $70.4 \pm 2.7\%$ accuracy, outperforming unimodal and prior multimodal approaches. Explainability analyses highlight neuropathologically relevant brain regions and genes, enhancing clinical trust. OmniBrain offers a robust, interpretable, and practical solution for real-world Alzheimer's diagnosis.
format Preprint
id arxiv_https___arxiv_org_abs_2507_20872
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease
Sharshar, Ahmed
Ashraf, Yasser
Bakr, Tameem
Hassan, Salma
Elgendy, Hosam
Yaqub, Mohammad
Guizani, Mohsen
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Alzheimer's disease affects over 55 million people worldwide and is projected to more than double by 2050, necessitating rapid, accurate, and scalable diagnostics. However, existing approaches are limited because they cannot achieve clinically acceptable accuracy, generalization across datasets, robustness to missing modalities, and explainability all at the same time. This inability to satisfy all these requirements simultaneously undermines their reliability in clinical settings. We propose OmniBrain, a multimodal framework that integrates brain MRI, radiomics, gene expression, and clinical data using a unified model with cross-attention and modality dropout. OmniBrain achieves $92.2 \pm 2.4\%$accuracy on the ANMerge dataset and generalizes to the MRI-only ADNI dataset with $70.4 \pm 2.7\%$ accuracy, outperforming unimodal and prior multimodal approaches. Explainability analyses highlight neuropathologically relevant brain regions and genes, enhancing clinical trust. OmniBrain offers a robust, interpretable, and practical solution for real-world Alzheimer's diagnosis.
title Not Only Grey Matter: OmniBrain for Robust Multimodal Classification of Alzheimer's Disease
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2507.20872