Performance Modeling for Correlation-based Neural Decoding of Auditory Attention to Speech

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Geirnaert, Simon, Vanthornhout, Jonas, Francart, Tom, Bertrand, Alexander
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913894806585344
author Geirnaert, Simon
Vanthornhout, Jonas
Francart, Tom
Bertrand, Alexander
author_facet Geirnaert, Simon
Vanthornhout, Jonas
Francart, Tom
Bertrand, Alexander
contents Correlation-based auditory attention decoding (AAD) algorithms exploit neural tracking mechanisms to determine listener attention among competing speech sources via, e.g., electroencephalography signals. The correlation coefficients between the decoded neural responses and encoded speech stimuli of the different speakers then serve as AAD decision variables. A critical trade-off exists between the temporal resolution (the decision window length used to compute these correlations) and the AAD accuracy. This trade-off is typically characterized by evaluating AAD accuracy across multiple window lengths, leading to the performance curve. We propose a novel method to model this trade-off curve using labeled correlations from only a single decision window length. Our approach models the (un)attended correlations with a normal distribution after applying the Fisher transformation, enabling accurate AAD accuracy prediction across different window lengths. We validate the method on two distinct AAD implementations: a linear decoder and the non-linear VLAAI deep neural network, evaluated on separate datasets. Results show consistently low modeling errors of approximately 2 percent points, with 94% of true accuracies falling within estimated 95%-confidence intervals. The proposed method enables efficient performance curve modeling without extensive multi-window length evaluation, facilitating practical applications in, e.g., performance tracking in neuro-steered hearing devices to continuously adapt the system parameters over time.
format Preprint
id arxiv_https___arxiv_org_abs_2503_09349
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Performance Modeling for Correlation-based Neural Decoding of Auditory Attention to Speech
Geirnaert, Simon
Vanthornhout, Jonas
Francart, Tom
Bertrand, Alexander
Signal Processing
Sound
Audio and Speech Processing
Neurons and Cognition
Correlation-based auditory attention decoding (AAD) algorithms exploit neural tracking mechanisms to determine listener attention among competing speech sources via, e.g., electroencephalography signals. The correlation coefficients between the decoded neural responses and encoded speech stimuli of the different speakers then serve as AAD decision variables. A critical trade-off exists between the temporal resolution (the decision window length used to compute these correlations) and the AAD accuracy. This trade-off is typically characterized by evaluating AAD accuracy across multiple window lengths, leading to the performance curve. We propose a novel method to model this trade-off curve using labeled correlations from only a single decision window length. Our approach models the (un)attended correlations with a normal distribution after applying the Fisher transformation, enabling accurate AAD accuracy prediction across different window lengths. We validate the method on two distinct AAD implementations: a linear decoder and the non-linear VLAAI deep neural network, evaluated on separate datasets. Results show consistently low modeling errors of approximately 2 percent points, with 94% of true accuracies falling within estimated 95%-confidence intervals. The proposed method enables efficient performance curve modeling without extensive multi-window length evaluation, facilitating practical applications in, e.g., performance tracking in neuro-steered hearing devices to continuously adapt the system parameters over time.
title Performance Modeling for Correlation-based Neural Decoding of Auditory Attention to Speech
topic Signal Processing
Sound
Audio and Speech Processing
Neurons and Cognition
url https://arxiv.org/abs/2503.09349