Useful but Distracting: Keyword Highlights and Time-Synchronization in Captions for Language Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Draxler, Fiona, Weingärtner, Henrike, Windl, Maximiliane, Schmidt, Albrecht, Chuang, Lewis L.
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916693338488832
author Draxler, Fiona
Weingärtner, Henrike
Windl, Maximiliane
Schmidt, Albrecht
Chuang, Lewis L.
author_facet Draxler, Fiona
Weingärtner, Henrike
Windl, Maximiliane
Schmidt, Albrecht
Chuang, Lewis L.
contents Captions provide language learners with a scaffold for comprehension and vocabulary acquisition. Past work has proposed several enhancements such as keyword highlights for increased learning gains. However, little is known about learners' experience with enhanced captions, although this is critical for adoption in everyday life. We conducted a survey and focus group to elicit learner preferences and requirements and implemented a processing pipeline for enhanced captions with keyword highlights, time-synchronized keyword highlights, and keyword captions. A subsequent online study (n = 49) showed that time-synchronized keyword highlights were the preferred design for learning but were perceived as too distracting to replace standard captions in everyday viewing scenarios. We conclude that keyword highlights and time-synchronization are suitable for integrating learning into an entertaining everyday-life activity, but the design should be optimized to provide a more seamless experience.
format Preprint
id arxiv_https___arxiv_org_abs_2307_05870
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Useful but Distracting: Keyword Highlights and Time-Synchronization in Captions for Language Learning
Draxler, Fiona
Weingärtner, Henrike
Windl, Maximiliane
Schmidt, Albrecht
Chuang, Lewis L.
Human-Computer Interaction
H.5.2; K.3.1
Captions provide language learners with a scaffold for comprehension and vocabulary acquisition. Past work has proposed several enhancements such as keyword highlights for increased learning gains. However, little is known about learners' experience with enhanced captions, although this is critical for adoption in everyday life. We conducted a survey and focus group to elicit learner preferences and requirements and implemented a processing pipeline for enhanced captions with keyword highlights, time-synchronized keyword highlights, and keyword captions. A subsequent online study (n = 49) showed that time-synchronized keyword highlights were the preferred design for learning but were perceived as too distracting to replace standard captions in everyday viewing scenarios. We conclude that keyword highlights and time-synchronization are suitable for integrating learning into an entertaining everyday-life activity, but the design should be optimized to provide a more seamless experience.
title Useful but Distracting: Keyword Highlights and Time-Synchronization in Captions for Language Learning
topic Human-Computer Interaction
H.5.2; K.3.1
url https://arxiv.org/abs/2307.05870