A Multidimensional Assessment Method for Situated Visualization Understanding (MdamV)

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Saske, Antonia, Koesten, Laura, Möller, Torsten, Staudner, Judith, Kritzinger, Sylvia
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915590329860096
author Saske, Antonia
Koesten, Laura
Möller, Torsten
Staudner, Judith
Kritzinger, Sylvia
author_facet Saske, Antonia
Koesten, Laura
Möller, Torsten
Staudner, Judith
Kritzinger, Sylvia
contents How audiences read, interpret, and critique data visualizations is mainly assessed through performance tests featuring tasks like value retrieval. Yet, other factors shown to shape visualization understanding, such as numeracy, graph familiarity, and aesthetic perception, remain underrepresented in existing instruments. To address this, we design and test a Multidimensional Assessment Method of Situated Visualization Understanding (MdamV). This method integrates task-based measures with self-perceived ability ratings and open-ended critique, applied directly to the visualizations being read. Grounded in learning sciences frameworks that view understanding as a multifaceted process, MdamV spans six dimensions: Comprehending, Decoding, Aestheticizing, Critiquing, Reading, and Contextualizing. Validation was supported by a survey (N=438) representative of Austria's population (ages 18-74, male/female split), using a line chart and a bar chart on climate data. Findings show, for example, that about a quarter of respondents indicate deficits in comprehending simple data units, roughly one in five people felt unfamiliar with each chart type, and self-assessed numeracy was significantly related to data reading performance (p=0.0004). Overall, the evaluation of MdamV demonstrates the value of assessing visualization understanding beyond performance, framing it as a situated process tied to particular visualizations.
format Preprint
id arxiv_https___arxiv_org_abs_2410_23807
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Multidimensional Assessment Method for Situated Visualization Understanding (MdamV)
Saske, Antonia
Koesten, Laura
Möller, Torsten
Staudner, Judith
Kritzinger, Sylvia
Human-Computer Interaction
How audiences read, interpret, and critique data visualizations is mainly assessed through performance tests featuring tasks like value retrieval. Yet, other factors shown to shape visualization understanding, such as numeracy, graph familiarity, and aesthetic perception, remain underrepresented in existing instruments. To address this, we design and test a Multidimensional Assessment Method of Situated Visualization Understanding (MdamV). This method integrates task-based measures with self-perceived ability ratings and open-ended critique, applied directly to the visualizations being read. Grounded in learning sciences frameworks that view understanding as a multifaceted process, MdamV spans six dimensions: Comprehending, Decoding, Aestheticizing, Critiquing, Reading, and Contextualizing. Validation was supported by a survey (N=438) representative of Austria's population (ages 18-74, male/female split), using a line chart and a bar chart on climate data. Findings show, for example, that about a quarter of respondents indicate deficits in comprehending simple data units, roughly one in five people felt unfamiliar with each chart type, and self-assessed numeracy was significantly related to data reading performance (p=0.0004). Overall, the evaluation of MdamV demonstrates the value of assessing visualization understanding beyond performance, framing it as a situated process tied to particular visualizations.
title A Multidimensional Assessment Method for Situated Visualization Understanding (MdamV)
topic Human-Computer Interaction
url https://arxiv.org/abs/2410.23807