Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kamath, Sanchita S., Zeidieh, Aziz N., Seo, JooYoung
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915441396416512
author Kamath, Sanchita S.
Zeidieh, Aziz N.
Seo, JooYoung
author_facet Kamath, Sanchita S.
Zeidieh, Aziz N.
Seo, JooYoung
contents Blind and low-vision (BLV) users remain largely excluded from three-dimensional (3D) surface and point data visualizations due to the reliance on visual interaction. Existing approaches inadequately support non-visual access, especially in browser-based environments. This study introduces DIXTRAL, a hosted web-native system, co-designed with BLV researchers to address these gaps through multimodal interaction. Conducted with two blind and one sighted researcher, this study took place over sustained design sessions. Data were gathered through iterative testing of the prototype, collecting feedback on spatial navigation, sonification, and usability. Co-design observations demonstrate that synchronized auditory, visual, and textual feedback, combined with keyboard and gamepad navigation, enhances both structure discovery and orientation. DIXTRAL aims to improve access to 3D continuous scalar fields for BLV users and inform best practices for creating inclusive 3D visualizations.
format Preprint
id arxiv_https___arxiv_org_abs_2508_08554
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations
Kamath, Sanchita S.
Zeidieh, Aziz N.
Seo, JooYoung
Human-Computer Interaction
Blind and low-vision (BLV) users remain largely excluded from three-dimensional (3D) surface and point data visualizations due to the reliance on visual interaction. Existing approaches inadequately support non-visual access, especially in browser-based environments. This study introduces DIXTRAL, a hosted web-native system, co-designed with BLV researchers to address these gaps through multimodal interaction. Conducted with two blind and one sighted researcher, this study took place over sustained design sessions. Data were gathered through iterative testing of the prototype, collecting feedback on spatial navigation, sonification, and usability. Co-design observations demonstrate that synchronized auditory, visual, and textual feedback, combined with keyboard and gamepad navigation, enhances both structure discovery and orientation. DIXTRAL aims to improve access to 3D continuous scalar fields for BLV users and inform best practices for creating inclusive 3D visualizations.
title Explore, Listen, Inspect: Supporting Multimodal Interaction with 3D Surface and Point Data Visualizations
topic Human-Computer Interaction
url https://arxiv.org/abs/2508.08554