RetAssist: Facilitating Vocabulary Learners with Generative Images in Story Retelling Practices
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914809407078400 |
|---|---|
| author | Chen, Qiaoyi Liu, Siyu Huang, Kaihui Wang, Xingbo Ma, Xiaojuan Zhu, Junkai Peng, Zhenhui |
| author_facet | Chen, Qiaoyi Liu, Siyu Huang, Kaihui Wang, Xingbo Ma, Xiaojuan Zhu, Junkai Peng, Zhenhui |
| contents | Reading and repeatedly retelling a short story is a common and effective approach to learning the meanings and usages of target words. However, learners often struggle with comprehending, recalling, and retelling the story contexts of these target words. Inspired by the Cognitive Theory of Multimedia Learning, we propose a computational workflow to generate relevant images paired with stories. Based on the workflow, we work with learners and teachers to iteratively design an interactive vocabulary learning system named RetAssist. It can generate sentence-level images of a story to facilitate the understanding and recall of the target words in the story retelling practices. Our within-subjects study (N=24) shows that compared to a baseline system without generative images, RetAssist significantly improves learners' fluency in expressing with target words. Participants also feel that RetAssist eases their learning workload and is more useful. We discuss insights into leveraging text-to-image generative models to support learning tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_14794 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RetAssist: Facilitating Vocabulary Learners with Generative Images in Story Retelling Practices Chen, Qiaoyi Liu, Siyu Huang, Kaihui Wang, Xingbo Ma, Xiaojuan Zhu, Junkai Peng, Zhenhui Human-Computer Interaction Reading and repeatedly retelling a short story is a common and effective approach to learning the meanings and usages of target words. However, learners often struggle with comprehending, recalling, and retelling the story contexts of these target words. Inspired by the Cognitive Theory of Multimedia Learning, we propose a computational workflow to generate relevant images paired with stories. Based on the workflow, we work with learners and teachers to iteratively design an interactive vocabulary learning system named RetAssist. It can generate sentence-level images of a story to facilitate the understanding and recall of the target words in the story retelling practices. Our within-subjects study (N=24) shows that compared to a baseline system without generative images, RetAssist significantly improves learners' fluency in expressing with target words. Participants also feel that RetAssist eases their learning workload and is more useful. We discuss insights into leveraging text-to-image generative models to support learning tasks. |
| title | RetAssist: Facilitating Vocabulary Learners with Generative Images in Story Retelling Practices |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2405.14794 |