Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Siyang, Wang, Hongbin, Chen, Xiaoqing, Wu, Dongrui
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909477390778368
author Li, Siyang
Wang, Hongbin
Chen, Xiaoqing
Wu, Dongrui
author_facet Li, Siyang
Wang, Hongbin
Chen, Xiaoqing
Wu, Dongrui
contents Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements, a unified view of diversified approaches, and a comprehensive analysis of the present state of the field. We emphasize algorithmic advancements in cross-modality mapping, sequential modeling, besides classic multi-modality fusion, illustrating how these novel AI approaches enhance decoding of brain data. The current literature of BCI applications on visual, speech, and affective decoding are comprehensively explored. Looking forward, we draw attention on the impact of emerging architectures like multimodal Transformers, and discuss challenges such as brain data heterogeneity and common errors. This review also serves as a bridge in this interdisciplinary field for experts with neuroscience background and experts that study AI, aiming to provide a comprehensive understanding for AI-powered multimodal BCIs.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02830
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies
Li, Siyang
Wang, Hongbin
Chen, Xiaoqing
Wu, Dongrui
Human-Computer Interaction
Machine Learning
Neurons and Cognition
Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements, a unified view of diversified approaches, and a comprehensive analysis of the present state of the field. We emphasize algorithmic advancements in cross-modality mapping, sequential modeling, besides classic multi-modality fusion, illustrating how these novel AI approaches enhance decoding of brain data. The current literature of BCI applications on visual, speech, and affective decoding are comprehensively explored. Looking forward, we draw attention on the impact of emerging architectures like multimodal Transformers, and discuss challenges such as brain data heterogeneity and common errors. This review also serves as a bridge in this interdisciplinary field for experts with neuroscience background and experts that study AI, aiming to provide a comprehensive understanding for AI-powered multimodal BCIs.
title Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies
topic Human-Computer Interaction
Machine Learning
Neurons and Cognition
url https://arxiv.org/abs/2502.02830