Advancing Brainwave Modeling with a Codebook-Based Foundation Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Barmpas, Konstantinos, Lee, Na, Panagakis, Yannis, Adamos, Dimitrios A., Laskaris, Nikolaos, Zafeiriou, Stefanos
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916989406019584
author Barmpas, Konstantinos
Lee, Na
Panagakis, Yannis
Adamos, Dimitrios A.
Laskaris, Nikolaos
Zafeiriou, Stefanos
author_facet Barmpas, Konstantinos
Lee, Na
Panagakis, Yannis
Adamos, Dimitrios A.
Laskaris, Nikolaos
Zafeiriou, Stefanos
contents Recent advances in large-scale pre-trained Electroencephalogram (EEG) models have shown great promise, driving progress in Brain-Computer Interfaces (BCIs) and healthcare applications. However, despite their success, many existing pre-trained models have struggled to fully capture the rich information content of neural oscillations, a limitation that fundamentally constrains their performance and generalizability across diverse BCI tasks. This limitation is frequently rooted in suboptimal architectural design choices which constrain their representational capacity. In this work, we introduce LaBraM++, an enhanced Large Brainwave Foundation Model (LBM) that incorporates principled improvements grounded in robust signal processing foundations. LaBraM++ demonstrates substantial gains across a variety of tasks, consistently outperforming its originally-based architecture and achieving competitive results when compared to other open-source LBMs. Its superior performance and training efficiency highlight its potential as a strong foundation for future advancements in LBMs.
format Preprint
id arxiv_https___arxiv_org_abs_2505_16724
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advancing Brainwave Modeling with a Codebook-Based Foundation Model
Barmpas, Konstantinos
Lee, Na
Panagakis, Yannis
Adamos, Dimitrios A.
Laskaris, Nikolaos
Zafeiriou, Stefanos
Machine Learning
Artificial Intelligence
Human-Computer Interaction
Recent advances in large-scale pre-trained Electroencephalogram (EEG) models have shown great promise, driving progress in Brain-Computer Interfaces (BCIs) and healthcare applications. However, despite their success, many existing pre-trained models have struggled to fully capture the rich information content of neural oscillations, a limitation that fundamentally constrains their performance and generalizability across diverse BCI tasks. This limitation is frequently rooted in suboptimal architectural design choices which constrain their representational capacity. In this work, we introduce LaBraM++, an enhanced Large Brainwave Foundation Model (LBM) that incorporates principled improvements grounded in robust signal processing foundations. LaBraM++ demonstrates substantial gains across a variety of tasks, consistently outperforming its originally-based architecture and achieving competitive results when compared to other open-source LBMs. Its superior performance and training efficiency highlight its potential as a strong foundation for future advancements in LBMs.
title Advancing Brainwave Modeling with a Codebook-Based Foundation Model
topic Machine Learning
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2505.16724