Visual Validation versus Visual Estimation: A Study on the Average Value in Scatterplots
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914626784985088 |
|---|---|
| author | Braun, Daniel Suh, Ashley Chang, Remco Gleicher, Michael von Landesberger, Tatiana |
| author_facet | Braun, Daniel Suh, Ashley Chang, Remco Gleicher, Michael von Landesberger, Tatiana |
| contents | We investigate the ability of individuals to visually validate statistical models in terms of their fit to the data. While visual model estimation has been studied extensively, visual model validation remains under-investigated. It is unknown how well people are able to visually validate models, and how their performance compares to visual and computational estimation. As a starting point, we conducted a study across two populations (crowdsourced and volunteers). Participants had to both visually estimate (i.e, draw) and visually validate (i.e., accept or reject) the frequently studied model of averages. Across both populations, the level of accuracy of the models that were considered valid was lower than the accuracy of the estimated models. We find that participants' validation and estimation were unbiased. Moreover, their natural critical point between accepting and rejecting a given mean value is close to the boundary of its 95% confidence interval, indicating that the visually perceived confidence interval corresponds to a common statistical standard. Our work contributes to the understanding of visual model validation and opens new research opportunities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_09330 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Visual Validation versus Visual Estimation: A Study on the Average Value in Scatterplots Braun, Daniel Suh, Ashley Chang, Remco Gleicher, Michael von Landesberger, Tatiana Computer Vision and Pattern Recognition Graphics We investigate the ability of individuals to visually validate statistical models in terms of their fit to the data. While visual model estimation has been studied extensively, visual model validation remains under-investigated. It is unknown how well people are able to visually validate models, and how their performance compares to visual and computational estimation. As a starting point, we conducted a study across two populations (crowdsourced and volunteers). Participants had to both visually estimate (i.e, draw) and visually validate (i.e., accept or reject) the frequently studied model of averages. Across both populations, the level of accuracy of the models that were considered valid was lower than the accuracy of the estimated models. We find that participants' validation and estimation were unbiased. Moreover, their natural critical point between accepting and rejecting a given mean value is close to the boundary of its 95% confidence interval, indicating that the visually perceived confidence interval corresponds to a common statistical standard. Our work contributes to the understanding of visual model validation and opens new research opportunities. |
| title | Visual Validation versus Visual Estimation: A Study on the Average Value in Scatterplots |
| topic | Computer Vision and Pattern Recognition Graphics |
| url | https://arxiv.org/abs/2307.09330 |