Design Probes for AI-Driven AAC: Addressing Complex Communication Needs in Aphasia

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mao, Lei, Lee, Jong Ho, Shah, Yasmeen Faroqi, Valencia, Stephanie
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916687839756288
author Mao, Lei
Lee, Jong Ho
Shah, Yasmeen Faroqi
Valencia, Stephanie
author_facet Mao, Lei
Lee, Jong Ho
Shah, Yasmeen Faroqi
Valencia, Stephanie
contents AI offers key advantages such as instant generation, multi-modal support, and personalized adaptability - potential that can address the highly heterogeneous communication barriers faced by people with aphasia (PWAs). We designed AI-enhanced communication tools and used them as design probes to explore how AI's real-time processing and generation capabilities - across text, image, and audio - can align with PWAs' needs in real-time communication and preparation for future conversations respectively. Through a two-phase "Research through Design" approach, eleven PWAs contributed design insights and evaluated four AI-enhanced prototypes. These prototypes aimed to improve communication grounding and conversational agency through visual verification, grammar construction support, error correction, and reduced language processing load. Despite some challenges, such as occasional mismatches with user intent, findings demonstrate how AI's specific capabilities can be advantageous in addressing PWAs' complex needs. Our work contributes design insights for future Augmentative and Alternative Communication (AAC) systems.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09435
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Design Probes for AI-Driven AAC: Addressing Complex Communication Needs in Aphasia
Mao, Lei
Lee, Jong Ho
Shah, Yasmeen Faroqi
Valencia, Stephanie
Human-Computer Interaction
AI offers key advantages such as instant generation, multi-modal support, and personalized adaptability - potential that can address the highly heterogeneous communication barriers faced by people with aphasia (PWAs). We designed AI-enhanced communication tools and used them as design probes to explore how AI's real-time processing and generation capabilities - across text, image, and audio - can align with PWAs' needs in real-time communication and preparation for future conversations respectively. Through a two-phase "Research through Design" approach, eleven PWAs contributed design insights and evaluated four AI-enhanced prototypes. These prototypes aimed to improve communication grounding and conversational agency through visual verification, grammar construction support, error correction, and reduced language processing load. Despite some challenges, such as occasional mismatches with user intent, findings demonstrate how AI's specific capabilities can be advantageous in addressing PWAs' complex needs. Our work contributes design insights for future Augmentative and Alternative Communication (AAC) systems.
title Design Probes for AI-Driven AAC: Addressing Complex Communication Needs in Aphasia
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.09435