To MT or not to MT: An eye-tracking study on the reception by Dutch readers of different translation and creativity levels

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gerrits, Kyo, Guerberof-Arenas, Ana
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912350346412032
author Gerrits, Kyo
Guerberof-Arenas, Ana
author_facet Gerrits, Kyo
Guerberof-Arenas, Ana
contents This article presents the results of a pilot study involving the reception of a fictional short story translated from English into Dutch under four conditions: machine translation (MT), post-editing (PE), human translation (HT) and original source text (ST). The aim is to understand how creativity and errors in different translation modalities affect readers, specifically regarding cognitive load. Eight participants filled in a questionnaire, read a story using an eye-tracker, and conducted a retrospective think-aloud (RTA) interview. The results show that units of creative potential (UCP) increase cognitive load and that this effect is highest for HT and lowest for MT; no effect of error was observed. Triangulating the data with RTAs leads us to hypothesize that the higher cognitive load in UCPs is linked to increases in reader enjoyment and immersion. The effect of translation creativity on cognitive load in different translation modalities at word-level is novel and opens up new avenues for further research. All the code and data are available at https://github.com/INCREC/Pilot_to_MT_or_not_to_MT
format Preprint
id arxiv_https___arxiv_org_abs_2504_19850
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle To MT or not to MT: An eye-tracking study on the reception by Dutch readers of different translation and creativity levels
Gerrits, Kyo
Guerberof-Arenas, Ana
Computation and Language
This article presents the results of a pilot study involving the reception of a fictional short story translated from English into Dutch under four conditions: machine translation (MT), post-editing (PE), human translation (HT) and original source text (ST). The aim is to understand how creativity and errors in different translation modalities affect readers, specifically regarding cognitive load. Eight participants filled in a questionnaire, read a story using an eye-tracker, and conducted a retrospective think-aloud (RTA) interview. The results show that units of creative potential (UCP) increase cognitive load and that this effect is highest for HT and lowest for MT; no effect of error was observed. Triangulating the data with RTAs leads us to hypothesize that the higher cognitive load in UCPs is linked to increases in reader enjoyment and immersion. The effect of translation creativity on cognitive load in different translation modalities at word-level is novel and opens up new avenues for further research. All the code and data are available at https://github.com/INCREC/Pilot_to_MT_or_not_to_MT
title To MT or not to MT: An eye-tracking study on the reception by Dutch readers of different translation and creativity levels
topic Computation and Language
url https://arxiv.org/abs/2504.19850