Error-related Potential driven Reinforcement Learning for adaptive Brain-Computer Interfaces

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fidêncio, Aline Xavier, Grün, Felix, Klaes, Christian, Iossifidis, Ioannis
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916631834263552
author Fidêncio, Aline Xavier
Grün, Felix
Klaes, Christian
Iossifidis, Ioannis
author_facet Fidêncio, Aline Xavier
Grün, Felix
Klaes, Christian
Iossifidis, Ioannis
contents Brain-computer interfaces (BCIs) provide alternative communication methods for individuals with motor disabilities by allowing control and interaction with external devices. Non-invasive BCIs, especially those using electroencephalography (EEG), are practical and safe for various applications. However, their performance is often hindered by EEG non-stationarities, caused by changing mental states or device characteristics like electrode impedance. This challenge has spurred research into adaptive BCIs that can handle such variations. In recent years, interest has grown in using error-related potentials (ErrPs) to enhance BCI performance. ErrPs, neural responses to errors, can be detected non-invasively and have been integrated into different BCI paradigms to improve performance through error correction or adaptation. This research introduces a novel adaptive ErrP-based BCI approach using reinforcement learning (RL). We demonstrate the feasibility of an RL-driven adaptive framework incorporating ErrPs and motor imagery. Utilizing two RL agents, the framework adapts dynamically to EEG non-stationarities. Validation was conducted using a publicly available motor imagery dataset and a fast-paced game designed to boost user engagement. Results show the framework's promise, with RL agents learning control policies from user interactions and achieving robust performance across datasets. However, a critical insight from the game-based protocol revealed that motor imagery in a high-speed interaction paradigm was largely ineffective for participants, highlighting task design limitations in real-time BCI applications. These findings underscore the potential of RL for adaptive BCIs while pointing out practical constraints related to task complexity and user responsiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2502_18594
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Error-related Potential driven Reinforcement Learning for adaptive Brain-Computer Interfaces
Fidêncio, Aline Xavier
Grün, Felix
Klaes, Christian
Iossifidis, Ioannis
Machine Learning
Human-Computer Interaction
Neurons and Cognition
F.2.0; I.2.6; I.6.6; I.2.m
Brain-computer interfaces (BCIs) provide alternative communication methods for individuals with motor disabilities by allowing control and interaction with external devices. Non-invasive BCIs, especially those using electroencephalography (EEG), are practical and safe for various applications. However, their performance is often hindered by EEG non-stationarities, caused by changing mental states or device characteristics like electrode impedance. This challenge has spurred research into adaptive BCIs that can handle such variations. In recent years, interest has grown in using error-related potentials (ErrPs) to enhance BCI performance. ErrPs, neural responses to errors, can be detected non-invasively and have been integrated into different BCI paradigms to improve performance through error correction or adaptation. This research introduces a novel adaptive ErrP-based BCI approach using reinforcement learning (RL). We demonstrate the feasibility of an RL-driven adaptive framework incorporating ErrPs and motor imagery. Utilizing two RL agents, the framework adapts dynamically to EEG non-stationarities. Validation was conducted using a publicly available motor imagery dataset and a fast-paced game designed to boost user engagement. Results show the framework's promise, with RL agents learning control policies from user interactions and achieving robust performance across datasets. However, a critical insight from the game-based protocol revealed that motor imagery in a high-speed interaction paradigm was largely ineffective for participants, highlighting task design limitations in real-time BCI applications. These findings underscore the potential of RL for adaptive BCIs while pointing out practical constraints related to task complexity and user responsiveness.
title Error-related Potential driven Reinforcement Learning for adaptive Brain-Computer Interfaces
topic Machine Learning
Human-Computer Interaction
Neurons and Cognition
F.2.0; I.2.6; I.6.6; I.2.m
url https://arxiv.org/abs/2502.18594