Tailored Real-time AR Captioning Interface for Enhancing Learning Experience of Deaf and Hard-of-Hearing (DHH) Students

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Samaradivakara, Yasith, Pathirage, Asela, Ushan, Thavindu, Sasikumar, Prasanth, Karunanayaka, Kasun, Keppitiyagama, Chamath, Nanayakkara, Suranga
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929658085244928
author Samaradivakara, Yasith
Pathirage, Asela
Ushan, Thavindu
Sasikumar, Prasanth
Karunanayaka, Kasun
Keppitiyagama, Chamath
Nanayakkara, Suranga
author_facet Samaradivakara, Yasith
Pathirage, Asela
Ushan, Thavindu
Sasikumar, Prasanth
Karunanayaka, Kasun
Keppitiyagama, Chamath
Nanayakkara, Suranga
contents Deaf and hard-of-hearing (DHH) students face significant challenges in specialized educational settings, such as limited exposure to written and spoken language, a lack of tailored educational tools, and restricted access to resources, impacting their language literacy development and overall educational experience. We, therefore, employed a User-Centered Design (UCD) process, collaborating with 8 DHH students and 2 Teachers of the Deaf (ToDs) from a School of Deaf to effectively develop and utilize a real-time captioning augmented reality (AR) system to their school settings, aiming to enhance their learning experience. User study with 24 DHH participants revealed a strong preference (87.5\%) for our system, underscoring its potential to enhance learning experience. We present a comprehensive needs analysis, the UCD process, system implementation, and user feedback, showcasing the effectiveness of tailored AR caption interfaces for DHH students. We also discuss the implications for future development of educational technologies for DHH students.
format Preprint
id arxiv_https___arxiv_org_abs_2501_02233
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tailored Real-time AR Captioning Interface for Enhancing Learning Experience of Deaf and Hard-of-Hearing (DHH) Students
Samaradivakara, Yasith
Pathirage, Asela
Ushan, Thavindu
Sasikumar, Prasanth
Karunanayaka, Kasun
Keppitiyagama, Chamath
Nanayakkara, Suranga
Human-Computer Interaction
Deaf and hard-of-hearing (DHH) students face significant challenges in specialized educational settings, such as limited exposure to written and spoken language, a lack of tailored educational tools, and restricted access to resources, impacting their language literacy development and overall educational experience. We, therefore, employed a User-Centered Design (UCD) process, collaborating with 8 DHH students and 2 Teachers of the Deaf (ToDs) from a School of Deaf to effectively develop and utilize a real-time captioning augmented reality (AR) system to their school settings, aiming to enhance their learning experience. User study with 24 DHH participants revealed a strong preference (87.5\%) for our system, underscoring its potential to enhance learning experience. We present a comprehensive needs analysis, the UCD process, system implementation, and user feedback, showcasing the effectiveness of tailored AR caption interfaces for DHH students. We also discuss the implications for future development of educational technologies for DHH students.
title Tailored Real-time AR Captioning Interface for Enhancing Learning Experience of Deaf and Hard-of-Hearing (DHH) Students
topic Human-Computer Interaction
url https://arxiv.org/abs/2501.02233