Testing the Test: Observations When Assessing Visualization Literacy of Domain Experts
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910601797697536 |
|---|---|
| author | Öney, Seyda Abdelaal, Moataz Kurzhals, Kuno Betz, Paul Kropp, Cordula Weiskopf, Daniel |
| author_facet | Öney, Seyda Abdelaal, Moataz Kurzhals, Kuno Betz, Paul Kropp, Cordula Weiskopf, Daniel |
| contents | Various standardized tests exist that assess individuals' visualization literacy. Their use can help to draw conclusions from studies. However, it is not taken into account that the test itself can create a pressure situation where participants might fear being exposed and assessed negatively. This is especially problematic when testing domain experts in design studies. We conducted interviews with experts from different domains performing the Mini-VLAT test for visualization literacy to identify potential problems. Our participants reported that the time limit per question, ambiguities in the questions and visualizations, and missing steps in the test procedure mainly had an impact on their performance and content. We discuss possible changes to the test design to address these issues and how such assessment methods could be integrated into existing evaluation procedures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_08101 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Testing the Test: Observations When Assessing Visualization Literacy of Domain Experts Öney, Seyda Abdelaal, Moataz Kurzhals, Kuno Betz, Paul Kropp, Cordula Weiskopf, Daniel Human-Computer Interaction Various standardized tests exist that assess individuals' visualization literacy. Their use can help to draw conclusions from studies. However, it is not taken into account that the test itself can create a pressure situation where participants might fear being exposed and assessed negatively. This is especially problematic when testing domain experts in design studies. We conducted interviews with experts from different domains performing the Mini-VLAT test for visualization literacy to identify potential problems. Our participants reported that the time limit per question, ambiguities in the questions and visualizations, and missing steps in the test procedure mainly had an impact on their performance and content. We discuss possible changes to the test design to address these issues and how such assessment methods could be integrated into existing evaluation procedures. |
| title | Testing the Test: Observations When Assessing Visualization Literacy of Domain Experts |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2409.08101 |