Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Säuberli, Andreas, Holzknecht, Franz, Haller, Patrick, Deilen, Silvana, Schiffl, Laura, Hansen-Schirra, Silvia, Ebling, Sarah
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911780585865216
author Säuberli, Andreas
Holzknecht, Franz
Haller, Patrick
Deilen, Silvana
Schiffl, Laura
Hansen-Schirra, Silvia
Ebling, Sarah
author_facet Säuberli, Andreas
Holzknecht, Franz
Haller, Patrick
Deilen, Silvana
Schiffl, Laura
Hansen-Schirra, Silvia
Ebling, Sarah
contents Text simplification refers to the process of increasing the comprehensibility of texts. Automatic text simplification models are most commonly evaluated by experts or crowdworkers instead of the primary target groups of simplified texts, such as persons with intellectual disabilities. We conducted an evaluation study of text comprehensibility including participants with and without intellectual disabilities reading unsimplified, automatically and manually simplified German texts on a tablet computer. We explored four different approaches to measuring comprehensibility: multiple-choice comprehension questions, perceived difficulty ratings, response time, and reading speed. The results revealed significant variations in these measurements, depending on the reader group and whether the text had undergone automatic or manual simplification. For the target group of persons with intellectual disabilities, comprehension questions emerged as the most reliable measure, while analyzing reading speed provided valuable insights into participants' reading behavior.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13094
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities
Säuberli, Andreas
Holzknecht, Franz
Haller, Patrick
Deilen, Silvana
Schiffl, Laura
Hansen-Schirra, Silvia
Ebling, Sarah
Computation and Language
Human-Computer Interaction
Text simplification refers to the process of increasing the comprehensibility of texts. Automatic text simplification models are most commonly evaluated by experts or crowdworkers instead of the primary target groups of simplified texts, such as persons with intellectual disabilities. We conducted an evaluation study of text comprehensibility including participants with and without intellectual disabilities reading unsimplified, automatically and manually simplified German texts on a tablet computer. We explored four different approaches to measuring comprehensibility: multiple-choice comprehension questions, perceived difficulty ratings, response time, and reading speed. The results revealed significant variations in these measurements, depending on the reader group and whether the text had undergone automatic or manual simplification. For the target group of persons with intellectual disabilities, comprehension questions emerged as the most reliable measure, while analyzing reading speed provided valuable insights into participants' reading behavior.
title Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities
topic Computation and Language
Human-Computer Interaction
url https://arxiv.org/abs/2402.13094