Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Jiyao, Duan, Peiyu, Dvornek, Nicha C., Staib, Lawrence H., Sukhodolsky, Denis, Ventola, Pamela, Duncan, James S.
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914609823219712
author Wang, Jiyao
Duan, Peiyu
Dvornek, Nicha C.
Staib, Lawrence H.
Sukhodolsky, Denis
Ventola, Pamela
Duncan, James S.
author_facet Wang, Jiyao
Duan, Peiyu
Dvornek, Nicha C.
Staib, Lawrence H.
Sukhodolsky, Denis
Ventola, Pamela
Duncan, James S.
contents Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small sample sizes and variable label quality, especially when targeting a specific neurological condition. Combined with the inherently high dimensionality of fMRI data, these limitations substantially increase the risk of model overfitting. Recent years have seen growing interest in developing fMRI foundation models by combining multiple datasets; however, the computational resources needed for pretraining and fine-tuning are often prohibitive. We show that a lightweight self-supervised framework yields representations that generalize across diverse downstream tasks, outperforming fully supervised baselines and approaching the performance of large-scale models. We introduce BrainSimSiam, a data-efficient self-supervised representation learning framework that leverages positive-only data pairs to learn robust and generalizable features. We demonstrate that the learned representations achieve strong performance across multiple downstream classification and regression tasks, highlighting the potential of BrainSimSiam for data-limited neuroimaging applications.
format Preprint
id arxiv_https___arxiv_org_abs_2605_28990
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning
Wang, Jiyao
Duan, Peiyu
Dvornek, Nicha C.
Staib, Lawrence H.
Sukhodolsky, Denis
Ventola, Pamela
Duncan, James S.
Machine Learning
Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small sample sizes and variable label quality, especially when targeting a specific neurological condition. Combined with the inherently high dimensionality of fMRI data, these limitations substantially increase the risk of model overfitting. Recent years have seen growing interest in developing fMRI foundation models by combining multiple datasets; however, the computational resources needed for pretraining and fine-tuning are often prohibitive. We show that a lightweight self-supervised framework yields representations that generalize across diverse downstream tasks, outperforming fully supervised baselines and approaching the performance of large-scale models. We introduce BrainSimSiam, a data-efficient self-supervised representation learning framework that leverages positive-only data pairs to learn robust and generalizable features. We demonstrate that the learned representations achieve strong performance across multiple downstream classification and regression tasks, highlighting the potential of BrainSimSiam for data-limited neuroimaging applications.
title Learning Robust and Task-Invariant Functional Representation from fMRI through Siamese Self-Supervised Learning
topic Machine Learning
url https://arxiv.org/abs/2605.28990