Saved in:
Bibliographic Details
Main Authors: de Gois, Túlio Sousa, Freitag, Raquel Meister Ko.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.15824
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911235905159168
author de Gois, Túlio Sousa
Freitag, Raquel Meister Ko.
author_facet de Gois, Túlio Sousa
Freitag, Raquel Meister Ko.
contents The cloze test, widely used due to its low cost and flexibility, makes it possible to assess reading comprehension by filling in gaps in texts, requiring the mobilization of diverse linguistic repertoires. However, traditional correction methods, based only on exact answers, limit the identification of nuances in student performance. This study proposes an automated evaluation model for the cloze test in Brazilian Portuguese, integrating orthographic (edit distance), grammatical (POS tagging) and semantic (similarity between embeddings) analyses. The integrated method demonstrated its effectiveness, achieving a high correlation with human evaluation (0.832). The results indicate that the automated approach is robust, sensitive to variations in linguistic repertoire and suitable for educational contexts that require scalability.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15824
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Avaliação de eficiência na leitura: uma abordagem baseada em PLN
de Gois, Túlio Sousa
Freitag, Raquel Meister Ko.
Computation and Language
The cloze test, widely used due to its low cost and flexibility, makes it possible to assess reading comprehension by filling in gaps in texts, requiring the mobilization of diverse linguistic repertoires. However, traditional correction methods, based only on exact answers, limit the identification of nuances in student performance. This study proposes an automated evaluation model for the cloze test in Brazilian Portuguese, integrating orthographic (edit distance), grammatical (POS tagging) and semantic (similarity between embeddings) analyses. The integrated method demonstrated its effectiveness, achieving a high correlation with human evaluation (0.832). The results indicate that the automated approach is robust, sensitive to variations in linguistic repertoire and suitable for educational contexts that require scalability.
title Avaliação de eficiência na leitura: uma abordagem baseada em PLN
topic Computation and Language
url https://arxiv.org/abs/2508.15824