Modelando procesos cognitivos de la lectura natural con GPT-2

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bianchi, Bruno, Umfurer, Alfredo, Kamienkowski, Juan Esteban
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917790609309696
author Bianchi, Bruno
Umfurer, Alfredo
Kamienkowski, Juan Esteban
author_facet Bianchi, Bruno
Umfurer, Alfredo
Kamienkowski, Juan Esteban
contents The advancement of the Natural Language Processing field has enabled the development of language models with a great capacity for generating text. In recent years, Neuroscience has been using these models to better understand cognitive processes. In previous studies, we found that models like Ngrams and LSTM networks can partially model Predictability when used as a co-variable to explain readers' eye movements. In the present work, we further this line of research by using GPT-2 based models. The results show that this architecture achieves better outcomes than its predecessors.
format Preprint
id arxiv_https___arxiv_org_abs_2409_20174
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Modelando procesos cognitivos de la lectura natural con GPT-2
Bianchi, Bruno
Umfurer, Alfredo
Kamienkowski, Juan Esteban
Neurons and Cognition
Artificial Intelligence
The advancement of the Natural Language Processing field has enabled the development of language models with a great capacity for generating text. In recent years, Neuroscience has been using these models to better understand cognitive processes. In previous studies, we found that models like Ngrams and LSTM networks can partially model Predictability when used as a co-variable to explain readers' eye movements. In the present work, we further this line of research by using GPT-2 based models. The results show that this architecture achieves better outcomes than its predecessors.
title Modelando procesos cognitivos de la lectura natural con GPT-2
topic Neurons and Cognition
Artificial Intelligence
url https://arxiv.org/abs/2409.20174