NeuroIncept Decoder for High-Fidelity Speech Reconstruction from Neural Activity
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908370917654528 |
|---|---|
| author | Khanday, Owais Mujtaba Pérez-Córdoba, José L. Mir, Mohd Yaqub Najar, Ashfaq Ahmad Gonzalez-Lopez, Jose A. |
| author_facet | Khanday, Owais Mujtaba Pérez-Córdoba, José L. Mir, Mohd Yaqub Najar, Ashfaq Ahmad Gonzalez-Lopez, Jose A. |
| contents | This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for individuals with severe speech impairments. Central to our approach is the integration of time-frequency features in the high-gamma band computed from EEG recordings with an advanced NeuroIncept Decoder architecture. This neural network architecture combines Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs) to reconstruct audio spectrograms from neural patterns. Our model demonstrates robust mean correlation coefficients between predicted and actual spectrograms, though inter-subject variability indicates distinct neural processing mechanisms among participants. Overall, our study highlights the potential of neural decoding techniques to restore communicative abilities in individuals with speech disorders and paves the way for future advancements in brain-computer interface technologies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_03757 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | NeuroIncept Decoder for High-Fidelity Speech Reconstruction from Neural Activity Khanday, Owais Mujtaba Pérez-Córdoba, José L. Mir, Mohd Yaqub Najar, Ashfaq Ahmad Gonzalez-Lopez, Jose A. Sound Human-Computer Interaction Audio and Speech Processing This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for individuals with severe speech impairments. Central to our approach is the integration of time-frequency features in the high-gamma band computed from EEG recordings with an advanced NeuroIncept Decoder architecture. This neural network architecture combines Convolutional Neural Networks (CNNs) and Gated Recurrent Units (GRUs) to reconstruct audio spectrograms from neural patterns. Our model demonstrates robust mean correlation coefficients between predicted and actual spectrograms, though inter-subject variability indicates distinct neural processing mechanisms among participants. Overall, our study highlights the potential of neural decoding techniques to restore communicative abilities in individuals with speech disorders and paves the way for future advancements in brain-computer interface technologies. |
| title | NeuroIncept Decoder for High-Fidelity Speech Reconstruction from Neural Activity |
| topic | Sound Human-Computer Interaction Audio and Speech Processing |
| url | https://arxiv.org/abs/2501.03757 |