A predictive learning model can simulate temporal dynamics and context effects found in neural representations of continuous speech
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929343266029568 |
|---|---|
| author | Liu, Oli Danyi Tang, Hao Feldman, Naomi Goldwater, Sharon |
| author_facet | Liu, Oli Danyi Tang, Hao Feldman, Naomi Goldwater, Sharon |
| contents | Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this temporal processing. In this study, we simulated similar analyses with representations extracted from a computational model that was trained on unlabelled speech with the learning objective of predicting upcoming acoustics. Our simulations revealed temporal dynamics similar to those in brain signals, implying that these properties can arise without linguistic knowledge. Another property shared between brains and the model is that the encoding patterns of phonemes support some degree of cross-context generalization. However, we found evidence that the effectiveness of these generalizations depends on the specific contexts, which suggests that this analysis alone is insufficient to support the presence of context-invariant encoding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_08237 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A predictive learning model can simulate temporal dynamics and context effects found in neural representations of continuous speech Liu, Oli Danyi Tang, Hao Feldman, Naomi Goldwater, Sharon Computation and Language Sound Audio and Speech Processing Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this temporal processing. In this study, we simulated similar analyses with representations extracted from a computational model that was trained on unlabelled speech with the learning objective of predicting upcoming acoustics. Our simulations revealed temporal dynamics similar to those in brain signals, implying that these properties can arise without linguistic knowledge. Another property shared between brains and the model is that the encoding patterns of phonemes support some degree of cross-context generalization. However, we found evidence that the effectiveness of these generalizations depends on the specific contexts, which suggests that this analysis alone is insufficient to support the presence of context-invariant encoding. |
| title | A predictive learning model can simulate temporal dynamics and context effects found in neural representations of continuous speech |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2405.08237 |