Saved in:
Bibliographic Details
Main Authors: Wang, Shaocong, Liu, Tong, Li, Yihan, Li, Ming, Wen, Kairui, Yang, Pei, Ji, Wenqi, Yu, Minjing, Liu, Yong-Jin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.20705
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911596317507584
author Wang, Shaocong
Liu, Tong
Li, Yihan
Li, Ming
Wen, Kairui
Yang, Pei
Ji, Wenqi
Yu, Minjing
Liu, Yong-Jin
author_facet Wang, Shaocong
Liu, Tong
Li, Yihan
Li, Ming
Wen, Kairui
Yang, Pei
Ji, Wenqi
Yu, Minjing
Liu, Yong-Jin
contents Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such objectives are inherently limited in capturing the global dynamics and long-range dependencies essential for characterizing neural activity. To address this limitation, we propose EEGDM, a novel self-supervised framework that leverages latent diffusion models to generate EEG signals as an objective. Unlike masked reconstruction, diffusion-based generation progressively denoises signals from noise to realism, compelling the model to capture holistic temporal patterns and cross-channel relationships. Specifically, EEGDM incorporates an EEG encoder that distills raw signals and their channel augmentations into a compact representation, acting as conditional information to guide the diffusion model for generating EEG signals. This design endows EEGDM with a compact latent space, which not only offers ample control over the generative process but also can be leveraged for downstream tasks. Experimental results show that EEGDM (1) reconstructs high-quality EEG signals, (2) learns robust representations, and (3) achieves competitive performance across diverse downstream tasks, thus exploring a new direction for self-supervised EEG representation learning.
format Preprint
id arxiv_https___arxiv_org_abs_2508_20705
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EEGDM: Learning EEG Representation with Latent Diffusion Model
Wang, Shaocong
Liu, Tong
Li, Yihan
Li, Ming
Wen, Kairui
Yang, Pei
Ji, Wenqi
Yu, Minjing
Liu, Yong-Jin
Machine Learning
Artificial Intelligence
Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such objectives are inherently limited in capturing the global dynamics and long-range dependencies essential for characterizing neural activity. To address this limitation, we propose EEGDM, a novel self-supervised framework that leverages latent diffusion models to generate EEG signals as an objective. Unlike masked reconstruction, diffusion-based generation progressively denoises signals from noise to realism, compelling the model to capture holistic temporal patterns and cross-channel relationships. Specifically, EEGDM incorporates an EEG encoder that distills raw signals and their channel augmentations into a compact representation, acting as conditional information to guide the diffusion model for generating EEG signals. This design endows EEGDM with a compact latent space, which not only offers ample control over the generative process but also can be leveraged for downstream tasks. Experimental results show that EEGDM (1) reconstructs high-quality EEG signals, (2) learns robust representations, and (3) achieves competitive performance across diverse downstream tasks, thus exploring a new direction for self-supervised EEG representation learning.
title EEGDM: Learning EEG Representation with Latent Diffusion Model
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2508.20705