EEG-Based Speech Decoding: A Novel Approach Using Multi-Kernel Ensemble Diffusion Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929591351771136 |
|---|---|
| author | Kim, Soowon Jo, Ha-Na Ko, Eunyeong |
| author_facet | Kim, Soowon Jo, Ha-Na Ko, Eunyeong |
| contents | In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three models with kernel sizes of 51, 101, and 201, effectively capturing multi-scale temporal features inherent in signals. This approach improves the robustness and accuracy of speech decoding by accommodating the rich temporal complexity of neural signals. The ensemble models work in conjunction with conditional autoencoders that refine the reconstructed signals and maximize the useful information for downstream classification tasks. The results indicate that the proposed ensemble-based approach significantly outperforms individual models and existing state-of-the-art techniques. These findings demonstrate the potential of ensemble methods in advancing brain signal decoding, offering new possibilities for non-verbal communication applications, particularly in brain-computer interface systems aimed at aiding individuals with speech impairments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_09302 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | EEG-Based Speech Decoding: A Novel Approach Using Multi-Kernel Ensemble Diffusion Models Kim, Soowon Jo, Ha-Na Ko, Eunyeong Sound Artificial Intelligence Audio and Speech Processing Signal Processing In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three models with kernel sizes of 51, 101, and 201, effectively capturing multi-scale temporal features inherent in signals. This approach improves the robustness and accuracy of speech decoding by accommodating the rich temporal complexity of neural signals. The ensemble models work in conjunction with conditional autoencoders that refine the reconstructed signals and maximize the useful information for downstream classification tasks. The results indicate that the proposed ensemble-based approach significantly outperforms individual models and existing state-of-the-art techniques. These findings demonstrate the potential of ensemble methods in advancing brain signal decoding, offering new possibilities for non-verbal communication applications, particularly in brain-computer interface systems aimed at aiding individuals with speech impairments. |
| title | EEG-Based Speech Decoding: A Novel Approach Using Multi-Kernel Ensemble Diffusion Models |
| topic | Sound Artificial Intelligence Audio and Speech Processing Signal Processing |
| url | https://arxiv.org/abs/2411.09302 |