CoMET: A Contrastive-Masked Brain Foundation Model for Universal EEG Representation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Ang, Wang, Zikai, Yang, Liuyin, Wang, Zhenyu, Xu, Tianheng, Hu, Honglin, Van Hulle, Marc M.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914014467981312
author Li, Ang
Wang, Zikai
Yang, Liuyin
Wang, Zhenyu
Xu, Tianheng
Hu, Honglin
Van Hulle, Marc M.
author_facet Li, Ang
Wang, Zikai
Yang, Liuyin
Wang, Zhenyu
Xu, Tianheng
Hu, Honglin
Van Hulle, Marc M.
contents Electroencephalography (EEG) is a non-invasive technique for recording brain activity, widely used in brain-computer interfaces, clinic, and healthcare. Traditional EEG deep models typically focus on specific dataset and task, limiting model size and generalization. Recently, self-supervised brain foundation models have emerged and been applied to various downstream tasks. Nevertheless, these models still have limitations: current SOTA models typically rely on masked reconstruction strategy; however, EEG features of adjacent channels are highly correlated, which causes the pre-training to overly focus on low-dimensional signal-similarity features in local regions and neglect the global discriminative patterns vital for downstream tasks. To address these limitations, we propose a brain foundation model called CoMET. Specifically, we employ the masked autoencoder with redesigned patching and embedding for EEG as backbone and devise a novel contrastive learning framework with mirror-scale augmentation to strengthen the global discrimination ability. CoMET is pre-trained on mixed EEG datasets over 3000 subjects with over one million samples. It is evaluated on ten different downstream datasets, and the SOTA results demonstrate CoMET's superior ability in extracting universal EEG representations and strong clinical potential.
format Preprint
id arxiv_https___arxiv_org_abs_2509_00314
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CoMET: A Contrastive-Masked Brain Foundation Model for Universal EEG Representation
Li, Ang
Wang, Zikai
Yang, Liuyin
Wang, Zhenyu
Xu, Tianheng
Hu, Honglin
Van Hulle, Marc M.
Signal Processing
Electroencephalography (EEG) is a non-invasive technique for recording brain activity, widely used in brain-computer interfaces, clinic, and healthcare. Traditional EEG deep models typically focus on specific dataset and task, limiting model size and generalization. Recently, self-supervised brain foundation models have emerged and been applied to various downstream tasks. Nevertheless, these models still have limitations: current SOTA models typically rely on masked reconstruction strategy; however, EEG features of adjacent channels are highly correlated, which causes the pre-training to overly focus on low-dimensional signal-similarity features in local regions and neglect the global discriminative patterns vital for downstream tasks. To address these limitations, we propose a brain foundation model called CoMET. Specifically, we employ the masked autoencoder with redesigned patching and embedding for EEG as backbone and devise a novel contrastive learning framework with mirror-scale augmentation to strengthen the global discrimination ability. CoMET is pre-trained on mixed EEG datasets over 3000 subjects with over one million samples. It is evaluated on ten different downstream datasets, and the SOTA results demonstrate CoMET's superior ability in extracting universal EEG representations and strong clinical potential.
title CoMET: A Contrastive-Masked Brain Foundation Model for Universal EEG Representation
topic Signal Processing
url https://arxiv.org/abs/2509.00314