Anatomical Foundation Models for Brain MRIs

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Barbano, Carlo Alberto, Brunello, Matteo, Dufumier, Benoit, Grangetto, Marco
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915626198499328
author Barbano, Carlo Alberto
Brunello, Matteo
Dufumier, Benoit
Grangetto, Marco
author_facet Barbano, Carlo Alberto
Brunello, Matteo
Dufumier, Benoit
Grangetto, Marco
contents Deep Learning (DL) in neuroimaging has become increasingly relevant for detecting neurological conditions and neurodegenerative disorders. One of the most predominant biomarkers in neuroimaging is represented by brain age, which has been shown to be a good indicator for different conditions, such as Alzheimer's Disease. Using brain age for weakly supervised pre-training of DL models in transfer learning settings has also recently shown promising results, especially when dealing with data scarcity of different conditions. On the other hand, anatomical information of brain MRIs (e.g. cortical thickness) can provide important information for learning good representations that can be transferred to many downstream tasks. In this work, we propose AnatCL, an anatomical foundation model for brain MRIs that i.) leverages anatomical information in a weakly contrastive learning approach, and ii.) achieves state-of-the-art performances across many different downstream tasks. To validate our approach we consider 12 different downstream tasks for the diagnosis of different conditions such as Alzheimer's Disease, autism spectrum disorder, and schizophrenia. Furthermore, we also target the prediction of 10 different clinical assessment scores using structural MRI data. Our findings show that incorporating anatomical information during pre-training leads to more robust and generalizable representations. Pre-trained models can be found at: https://github.com/EIDOSLAB/AnatCL.
format Preprint
id arxiv_https___arxiv_org_abs_2408_07079
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Anatomical Foundation Models for Brain MRIs
Barbano, Carlo Alberto
Brunello, Matteo
Dufumier, Benoit
Grangetto, Marco
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
68T07
I.2.6
Deep Learning (DL) in neuroimaging has become increasingly relevant for detecting neurological conditions and neurodegenerative disorders. One of the most predominant biomarkers in neuroimaging is represented by brain age, which has been shown to be a good indicator for different conditions, such as Alzheimer's Disease. Using brain age for weakly supervised pre-training of DL models in transfer learning settings has also recently shown promising results, especially when dealing with data scarcity of different conditions. On the other hand, anatomical information of brain MRIs (e.g. cortical thickness) can provide important information for learning good representations that can be transferred to many downstream tasks. In this work, we propose AnatCL, an anatomical foundation model for brain MRIs that i.) leverages anatomical information in a weakly contrastive learning approach, and ii.) achieves state-of-the-art performances across many different downstream tasks. To validate our approach we consider 12 different downstream tasks for the diagnosis of different conditions such as Alzheimer's Disease, autism spectrum disorder, and schizophrenia. Furthermore, we also target the prediction of 10 different clinical assessment scores using structural MRI data. Our findings show that incorporating anatomical information during pre-training leads to more robust and generalizable representations. Pre-trained models can be found at: https://github.com/EIDOSLAB/AnatCL.
title Anatomical Foundation Models for Brain MRIs
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
68T07
I.2.6
url https://arxiv.org/abs/2408.07079