Is Limited Participant Diversity Impeding EEG-based Machine Learning?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bomatter, Philipp, Gouk, Henry
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912678456328192
author Bomatter, Philipp
Gouk, Henry
author_facet Bomatter, Philipp
Gouk, Henry
contents The application of machine learning (ML) to electroencephalography (EEG) has great potential to advance both neuroscientific research and clinical applications. However, the generalisability and robustness of EEG-based ML models often hinge on the amount and diversity of training data. It is common practice to split EEG recordings into small segments, thereby increasing the number of samples substantially compared to the number of individual recordings or participants. We conceptualise this as a multi-level data generation process and investigate the scaling behaviour of model performance with respect to the overall sample size and the participant diversity through large-scale empirical studies. We then use the same framework to investigate the effectiveness of different ML strategies designed to address limited data problems: data augmentations and self-supervised learning. Our findings show that model performance scaling can be severely constrained by participant distribution shifts and provide actionable guidance for data collection and ML research. The code for our experiments is publicly available online.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13497
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Is Limited Participant Diversity Impeding EEG-based Machine Learning?
Bomatter, Philipp
Gouk, Henry
Signal Processing
Machine Learning
The application of machine learning (ML) to electroencephalography (EEG) has great potential to advance both neuroscientific research and clinical applications. However, the generalisability and robustness of EEG-based ML models often hinge on the amount and diversity of training data. It is common practice to split EEG recordings into small segments, thereby increasing the number of samples substantially compared to the number of individual recordings or participants. We conceptualise this as a multi-level data generation process and investigate the scaling behaviour of model performance with respect to the overall sample size and the participant diversity through large-scale empirical studies. We then use the same framework to investigate the effectiveness of different ML strategies designed to address limited data problems: data augmentations and self-supervised learning. Our findings show that model performance scaling can be severely constrained by participant distribution shifts and provide actionable guidance for data collection and ML research. The code for our experiments is publicly available online.
title Is Limited Participant Diversity Impeding EEG-based Machine Learning?
topic Signal Processing
Machine Learning
url https://arxiv.org/abs/2503.13497