Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.20174 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917790609309696 |
|---|---|
| author | Bianchi, Bruno Umfurer, Alfredo Kamienkowski, Juan Esteban |
| author_facet | Bianchi, Bruno Umfurer, Alfredo Kamienkowski, Juan Esteban |
| contents | The advancement of the Natural Language Processing field has enabled the development of language models with a great capacity for generating text. In recent years, Neuroscience has been using these models to better understand cognitive processes. In previous studies, we found that models like Ngrams and LSTM networks can partially model Predictability when used as a co-variable to explain readers' eye movements. In the present work, we further this line of research by using GPT-2 based models. The results show that this architecture achieves better outcomes than its predecessors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_20174 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Modelando procesos cognitivos de la lectura natural con GPT-2 Bianchi, Bruno Umfurer, Alfredo Kamienkowski, Juan Esteban Neurons and Cognition Artificial Intelligence The advancement of the Natural Language Processing field has enabled the development of language models with a great capacity for generating text. In recent years, Neuroscience has been using these models to better understand cognitive processes. In previous studies, we found that models like Ngrams and LSTM networks can partially model Predictability when used as a co-variable to explain readers' eye movements. In the present work, we further this line of research by using GPT-2 based models. The results show that this architecture achieves better outcomes than its predecessors. |
| title | Modelando procesos cognitivos de la lectura natural con GPT-2 |
| topic | Neurons and Cognition Artificial Intelligence |
| url | https://arxiv.org/abs/2409.20174 |