Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913336263704576 |
|---|---|
| author | Zhang, Yunhao Wang, Shaonan Dong, Xinyi Yu, Jiajun Zong, Chengqing |
| author_facet | Zhang, Yunhao Wang, Shaonan Dong, Xinyi Yu, Jiajun Zong, Chengqing |
| contents | Neural language models, particularly large-scale ones, have been consistently proven to be most effective in predicting brain neural activity across a range of studies. However, previous research overlooked the comparison of these models with psychologically plausible ones. Moreover, evaluations were reliant on limited, single-modality, and English cognitive datasets. To address these questions, we conducted an analysis comparing encoding performance of various neural language models and psychologically plausible models. Our study utilized extensive multi-modal cognitive datasets, examining bilingual word and discourse levels. Surprisingly, our findings revealed that psychologically plausible models outperformed neural language models across diverse contexts, encompassing different modalities such as fMRI and eye-tracking, and spanning languages from English to Chinese. Among psychologically plausible models, the one incorporating embodied information emerged as particularly exceptional. This model demonstrated superior performance at both word and discourse levels, exhibiting robust prediction of brain activation across numerous regions in both English and Chinese. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_19364 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models Zhang, Yunhao Wang, Shaonan Dong, Xinyi Yu, Jiajun Zong, Chengqing Computation and Language Neural language models, particularly large-scale ones, have been consistently proven to be most effective in predicting brain neural activity across a range of studies. However, previous research overlooked the comparison of these models with psychologically plausible ones. Moreover, evaluations were reliant on limited, single-modality, and English cognitive datasets. To address these questions, we conducted an analysis comparing encoding performance of various neural language models and psychologically plausible models. Our study utilized extensive multi-modal cognitive datasets, examining bilingual word and discourse levels. Surprisingly, our findings revealed that psychologically plausible models outperformed neural language models across diverse contexts, encompassing different modalities such as fMRI and eye-tracking, and spanning languages from English to Chinese. Among psychologically plausible models, the one incorporating embodied information emerged as particularly exceptional. This model demonstrated superior performance at both word and discourse levels, exhibiting robust prediction of brain activation across numerous regions in both English and Chinese. |
| title | Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2404.19364 |