Saved in:
Bibliographic Details
Main Authors: Kiesel, Charlotte, Mukherjee, Dipayan, Hasegawa-Johnson, Mark, Karahalios, Karrie
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.06202
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915377892556800
author Kiesel, Charlotte
Mukherjee, Dipayan
Hasegawa-Johnson, Mark
Karahalios, Karrie
author_facet Kiesel, Charlotte
Mukherjee, Dipayan
Hasegawa-Johnson, Mark
Karahalios, Karrie
contents Visual feedback speeds up learners' improvement of pronunciation in a second language. The visual combined with audio allows speakers to see sounds and differences in pronunciation that they are unable to hear. Prior studies have tested different visual methods for improving pronunciation, however, we do not have conclusive understanding of what aspects of the visualizations contributed to improvements. Based on previous work, we created V(is)owel, an interactive vowel chart. Vowel charts provide actionable feedback by directly mapping physical tongue movement onto a chart. We compared V(is)owel with an auditory-only method to explore how learners parse visual and auditory feedback to understand how and why visual feedback is effective for pronunciation improvement. The findings suggest that designers should include explicit anatomical feedback that directly maps onto physical movement for phonetically untrained learners. Furthermore, visual feedback has the potential to motivate more practice since all eight of the participants cited using the visuals as a goal with V(is)owel versus relying on their own judgment with audio alone. Their statements are backed up by all participants practicing words with V(is)owel more than with audio-only. Our results indicate that V(is)owel is effective at providing actionable feedback, demonstrating the potential of visual feedback methods in second language learning.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06202
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle V(is)owel: An Interactive Vowel Chart to Understand What Makes Visual Pronunciation Effective in Second Language Learning
Kiesel, Charlotte
Mukherjee, Dipayan
Hasegawa-Johnson, Mark
Karahalios, Karrie
Human-Computer Interaction
K.3.1
Visual feedback speeds up learners' improvement of pronunciation in a second language. The visual combined with audio allows speakers to see sounds and differences in pronunciation that they are unable to hear. Prior studies have tested different visual methods for improving pronunciation, however, we do not have conclusive understanding of what aspects of the visualizations contributed to improvements. Based on previous work, we created V(is)owel, an interactive vowel chart. Vowel charts provide actionable feedback by directly mapping physical tongue movement onto a chart. We compared V(is)owel with an auditory-only method to explore how learners parse visual and auditory feedback to understand how and why visual feedback is effective for pronunciation improvement. The findings suggest that designers should include explicit anatomical feedback that directly maps onto physical movement for phonetically untrained learners. Furthermore, visual feedback has the potential to motivate more practice since all eight of the participants cited using the visuals as a goal with V(is)owel versus relying on their own judgment with audio alone. Their statements are backed up by all participants practicing words with V(is)owel more than with audio-only. Our results indicate that V(is)owel is effective at providing actionable feedback, demonstrating the potential of visual feedback methods in second language learning.
title V(is)owel: An Interactive Vowel Chart to Understand What Makes Visual Pronunciation Effective in Second Language Learning
topic Human-Computer Interaction
K.3.1
url https://arxiv.org/abs/2507.06202