Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zidar, Lucija Mihić, Wicke, Philipp, Bhatia, Praneel, Lutz, Rosa, Klug, Marius, Zander, Thorsten O.
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2601.05825
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911415914201088
author Zidar, Lucija Mihić
Wicke, Philipp
Bhatia, Praneel
Lutz, Rosa
Klug, Marius
Zander, Thorsten O.
author_facet Zidar, Lucija Mihić
Wicke, Philipp
Bhatia, Praneel
Lutz, Rosa
Klug, Marius
Zander, Thorsten O.
contents Passive brain-computer interfaces offer a potential source of implicit feedback for alignment of large language models, but most mental state decoding has been done in controlled tasks. This paper investigates whether established EEG classifiers for mental workload and implicit agreement can be transferred to spoken human-AI dialogue. We introduce two conversational paradigms - a Spelling Bee task and a sentence completion task- and an end-to-end pipeline for transcribing, annotating, and aligning word-level conversational events with continuous EEG classifier output. In a pilot study, workload decoding showed interpretable trends during spoken interaction, supporting cross-paradigm transfer. For implicit agreement, we demonstrate continuous application and precise temporal alignment to conversational events, while identifying limitations related to construct transfer and asynchronous application of event-based classifiers. Overall, the results establish feasibility and constraints for integrating passive BCI signals into conversational AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2601_05825
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Decoding Workload and Agreement From EEG During Spoken Dialogue With Conversational AI
Zidar, Lucija Mihić
Wicke, Philipp
Bhatia, Praneel
Lutz, Rosa
Klug, Marius
Zander, Thorsten O.
Human-Computer Interaction
Artificial Intelligence
Passive brain-computer interfaces offer a potential source of implicit feedback for alignment of large language models, but most mental state decoding has been done in controlled tasks. This paper investigates whether established EEG classifiers for mental workload and implicit agreement can be transferred to spoken human-AI dialogue. We introduce two conversational paradigms - a Spelling Bee task and a sentence completion task- and an end-to-end pipeline for transcribing, annotating, and aligning word-level conversational events with continuous EEG classifier output. In a pilot study, workload decoding showed interpretable trends during spoken interaction, supporting cross-paradigm transfer. For implicit agreement, we demonstrate continuous application and precise temporal alignment to conversational events, while identifying limitations related to construct transfer and asynchronous application of event-based classifiers. Overall, the results establish feasibility and constraints for integrating passive BCI signals into conversational AI systems.
title Decoding Workload and Agreement From EEG During Spoken Dialogue With Conversational AI
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2601.05825