Fine-Grained Prediction of Reading Comprehension from Eye Movements
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913691964801024 |
|---|---|
| author | Shubi, Omer Meiri, Yoav Hadar, Cfir Avraham Berzak, Yevgeni |
| author_facet | Shubi, Omer Meiri, Yoav Hadar, Cfir Avraham Berzak, Yevgeni |
| contents | Can human reading comprehension be assessed from eye movements in reading? In this work, we address this longstanding question using large-scale eyetracking data over textual materials that are geared towards behavioral analyses of reading comprehension. We focus on a fine-grained and largely unaddressed task of predicting reading comprehension from eye movements at the level of a single question over a passage. We tackle this task using three new multimodal language models, as well as a battery of prior models from the literature. We evaluate the models' ability to generalize to new textual items, new participants, and the combination of both, in two different reading regimes, ordinary reading and information seeking. The evaluations suggest that although the task is highly challenging, eye movements contain useful signals for fine-grained prediction of reading comprehension. Code and data will be made publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_04484 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fine-Grained Prediction of Reading Comprehension from Eye Movements Shubi, Omer Meiri, Yoav Hadar, Cfir Avraham Berzak, Yevgeni Computation and Language Can human reading comprehension be assessed from eye movements in reading? In this work, we address this longstanding question using large-scale eyetracking data over textual materials that are geared towards behavioral analyses of reading comprehension. We focus on a fine-grained and largely unaddressed task of predicting reading comprehension from eye movements at the level of a single question over a passage. We tackle this task using three new multimodal language models, as well as a battery of prior models from the literature. We evaluate the models' ability to generalize to new textual items, new participants, and the combination of both, in two different reading regimes, ordinary reading and information seeking. The evaluations suggest that although the task is highly challenging, eye movements contain useful signals for fine-grained prediction of reading comprehension. Code and data will be made publicly available. |
| title | Fine-Grained Prediction of Reading Comprehension from Eye Movements |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2410.04484 |