Saved in:
Bibliographic Details
Main Authors: Zhang, Yuanming, Liang, Yayun, Lin, Zhibin, Lu, Jing
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.25605
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917531265007616
author Zhang, Yuanming
Liang, Yayun
Lin, Zhibin
Lu, Jing
author_facet Zhang, Yuanming
Liang, Yayun
Lin, Zhibin
Lu, Jing
contents In the past decade, numerous studies have applied deep neural networks (DNNs) to decode auditory attention (AAD) from Electroencephalogram (EEG) signals via stimulus reconstruction. However, the influence of dataset balance on the decoding performance of stimulus reconstruction-based AAD remains unexplored. In this study, three publicly available EEG-AAD datasets - KUL, DTU, and NJU cEEGrid - are used to construct both balanced and unbalanced experimental conditions. We hypothesize and demonstrate that stimulus reconstruction-based DNN decoders tend to produce overestimated decoding performance on unbalanced datasets. To address this issue, we propose a leave-one-paired-envelope-out (LOPEO) cross-validation protocol. Experimental results confirm that LOPEO effectively prevents inflated decoding accuracy on unbalanced datasets. While balanced datasets are generally preferred in experimental design, LOPEO provides a principled evaluation framework for unbalanced datasets that have already been published, filling an important gap in the field.
format Preprint
id arxiv_https___arxiv_org_abs_2605_25605
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Decoding Stimulus Reconstruction-Based Auditory Attention Robustly in Unbalanced EEG Datasets
Zhang, Yuanming
Liang, Yayun
Lin, Zhibin
Lu, Jing
Audio and Speech Processing
Machine Learning
In the past decade, numerous studies have applied deep neural networks (DNNs) to decode auditory attention (AAD) from Electroencephalogram (EEG) signals via stimulus reconstruction. However, the influence of dataset balance on the decoding performance of stimulus reconstruction-based AAD remains unexplored. In this study, three publicly available EEG-AAD datasets - KUL, DTU, and NJU cEEGrid - are used to construct both balanced and unbalanced experimental conditions. We hypothesize and demonstrate that stimulus reconstruction-based DNN decoders tend to produce overestimated decoding performance on unbalanced datasets. To address this issue, we propose a leave-one-paired-envelope-out (LOPEO) cross-validation protocol. Experimental results confirm that LOPEO effectively prevents inflated decoding accuracy on unbalanced datasets. While balanced datasets are generally preferred in experimental design, LOPEO provides a principled evaluation framework for unbalanced datasets that have already been published, filling an important gap in the field.
title Decoding Stimulus Reconstruction-Based Auditory Attention Robustly in Unbalanced EEG Datasets
topic Audio and Speech Processing
Machine Learning
url https://arxiv.org/abs/2605.25605