Bridging Brain with Foundation Models through Self-Supervised Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Altaheri, Hamdi, Karray, Fakhri, Islam, Md. Milon, Raju, S M Taslim Uddin, Karimi, Amir-Hossein
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915350712418304
author Altaheri, Hamdi
Karray, Fakhri
Islam, Md. Milon
Raju, S M Taslim Uddin
Karimi, Amir-Hossein
author_facet Altaheri, Hamdi
Karray, Fakhri
Islam, Md. Milon
Raju, S M Taslim Uddin
Karimi, Amir-Hossein
contents Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These advances present a transformative opportunity for brain signal analysis. Unlike traditional supervised learning, which is limited by the scarcity of labeled neural data, SSL offers a promising solution by enabling models to learn meaningful representations from unlabeled data. This is particularly valuable in addressing the unique challenges of brain signals, including high noise levels, inter-subject variability, and low signal-to-noise ratios. This survey systematically reviews the emerging field of bridging brain signals with foundation models through the innovative application of SSL. It explores key SSL techniques, the development of brain-specific foundation models, their adaptation to downstream tasks, and the integration of brain signals with other modalities in multimodal SSL frameworks. The review also covers commonly used evaluation metrics and benchmark datasets that support comparative analysis. Finally, it highlights key challenges and outlines future research directions. This work aims to provide researchers with a structured understanding of this rapidly evolving field and a roadmap for developing generalizable brain foundation models powered by self-supervision.
format Preprint
id arxiv_https___arxiv_org_abs_2506_16009
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging Brain with Foundation Models through Self-Supervised Learning
Altaheri, Hamdi
Karray, Fakhri
Islam, Md. Milon
Raju, S M Taslim Uddin
Karimi, Amir-Hossein
Machine Learning
Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These advances present a transformative opportunity for brain signal analysis. Unlike traditional supervised learning, which is limited by the scarcity of labeled neural data, SSL offers a promising solution by enabling models to learn meaningful representations from unlabeled data. This is particularly valuable in addressing the unique challenges of brain signals, including high noise levels, inter-subject variability, and low signal-to-noise ratios. This survey systematically reviews the emerging field of bridging brain signals with foundation models through the innovative application of SSL. It explores key SSL techniques, the development of brain-specific foundation models, their adaptation to downstream tasks, and the integration of brain signals with other modalities in multimodal SSL frameworks. The review also covers commonly used evaluation metrics and benchmark datasets that support comparative analysis. Finally, it highlights key challenges and outlines future research directions. This work aims to provide researchers with a structured understanding of this rapidly evolving field and a roadmap for developing generalizable brain foundation models powered by self-supervision.
title Bridging Brain with Foundation Models through Self-Supervised Learning
topic Machine Learning
url https://arxiv.org/abs/2506.16009