Speech-based Mark for Data Sonification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhao, Yichun, Lu, Jingyi, Nacenta, Miguel A
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911986680332288
author Zhao, Yichun
Lu, Jingyi
Nacenta, Miguel A
author_facet Zhao, Yichun
Lu, Jingyi
Nacenta, Miguel A
contents Sonification serves as a powerful tool for data accessibility, especially for people with vision loss. Among various modalities, speech is a familiar means of communication similar to the role of text in visualization. However, speech-based sonification is underexplored. We introduce SpeechTone, a novel speech-based mark for data sonification and extension to the existing Erie declarative grammar for sonification. It encodes data into speech attributes such as pitch, speed, voice and speech content. We demonstrate the efficacy of SpeechTone through three examples.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06942
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Speech-based Mark for Data Sonification
Zhao, Yichun
Lu, Jingyi
Nacenta, Miguel A
Human-Computer Interaction
Sonification serves as a powerful tool for data accessibility, especially for people with vision loss. Among various modalities, speech is a familiar means of communication similar to the role of text in visualization. However, speech-based sonification is underexplored. We introduce SpeechTone, a novel speech-based mark for data sonification and extension to the existing Erie declarative grammar for sonification. It encodes data into speech attributes such as pitch, speed, voice and speech content. We demonstrate the efficacy of SpeechTone through three examples.
title Speech-based Mark for Data Sonification
topic Human-Computer Interaction
url https://arxiv.org/abs/2408.06942