Data-Efficient Sleep Staging with Synthetic Time Series Pretraining

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Grieger, Niklas, Mehrkanoon, Siamak, Bialonski, Stephan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918142662410240
author Grieger, Niklas
Mehrkanoon, Siamak
Bialonski, Stephan
author_facet Grieger, Niklas
Mehrkanoon, Siamak
Bialonski, Stephan
contents Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such as self-supervised learning, have been suggested, but they typically rely on extensive empirical datasets. Inspired by recent advances in computer vision, we propose a pretraining task termed "frequency pretraining" to pretrain a neural network for sleep staging by predicting the frequency content of randomly generated synthetic time series. Our experiments demonstrate that our method surpasses fully supervised learning in scenarios with limited data and few subjects, and matches its performance in regimes with many subjects. Furthermore, our results underline the relevance of frequency information for sleep stage scoring, while also demonstrating that deep neural networks utilize information beyond frequencies to enhance sleep staging performance, which is consistent with previous research. We anticipate that our approach will be advantageous across a broad spectrum of applications where EEG data is limited or derived from a small number of subjects, including the domain of brain-computer interfaces.
format Preprint
id arxiv_https___arxiv_org_abs_2403_08592
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data-Efficient Sleep Staging with Synthetic Time Series Pretraining
Grieger, Niklas
Mehrkanoon, Siamak
Bialonski, Stephan
Machine Learning
Quantitative Methods
Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such as self-supervised learning, have been suggested, but they typically rely on extensive empirical datasets. Inspired by recent advances in computer vision, we propose a pretraining task termed "frequency pretraining" to pretrain a neural network for sleep staging by predicting the frequency content of randomly generated synthetic time series. Our experiments demonstrate that our method surpasses fully supervised learning in scenarios with limited data and few subjects, and matches its performance in regimes with many subjects. Furthermore, our results underline the relevance of frequency information for sleep stage scoring, while also demonstrating that deep neural networks utilize information beyond frequencies to enhance sleep staging performance, which is consistent with previous research. We anticipate that our approach will be advantageous across a broad spectrum of applications where EEG data is limited or derived from a small number of subjects, including the domain of brain-computer interfaces.
title Data-Efficient Sleep Staging with Synthetic Time Series Pretraining
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2403.08592