My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gaba, Aimen, Kaufman, Zhanna, Chueng, Jason, Shvakel, Marie, Hall, Kyle Wm., Brun, Yuriy, Bearfield, Cindy Xiong
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929206963732480
author Gaba, Aimen
Kaufman, Zhanna
Chueng, Jason
Shvakel, Marie
Hall, Kyle Wm.
Brun, Yuriy
Bearfield, Cindy Xiong
author_facet Gaba, Aimen
Kaufman, Zhanna
Chueng, Jason
Shvakel, Marie
Hall, Kyle Wm.
Brun, Yuriy
Bearfield, Cindy Xiong
contents Machine learning technology has become ubiquitous, but, unfortunately, often exhibits bias. As a consequence, disparate stakeholders need to interact with and make informed decisions about using machine learning models in everyday systems. Visualization technology can support stakeholders in understanding and evaluating trade-offs between, for example, accuracy and fairness of models. This paper aims to empirically answer "Can visualization design choices affect a stakeholder's perception of model bias, trust in a model, and willingness to adopt a model?" Through a series of controlled, crowd-sourced experiments with more than 1,500 participants, we identify a set of strategies people follow in deciding which models to trust. Our results show that men and women prioritize fairness and performance differently and that visual design choices significantly affect that prioritization. For example, women trust fairer models more often than men do, participants value fairness more when it is explained using text than as a bar chart, and being explicitly told a model is biased has a bigger impact than showing past biased performance. We test the generalizability of our results by comparing the effect of multiple textual and visual design choices and offer potential explanations of the cognitive mechanisms behind the difference in fairness perception and trust. Our research guides design considerations to support future work developing visualization systems for machine learning.
format Preprint
id arxiv_https___arxiv_org_abs_2308_03299
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine Learning
Gaba, Aimen
Kaufman, Zhanna
Chueng, Jason
Shvakel, Marie
Hall, Kyle Wm.
Brun, Yuriy
Bearfield, Cindy Xiong
Human-Computer Interaction
H.5.0
Machine learning technology has become ubiquitous, but, unfortunately, often exhibits bias. As a consequence, disparate stakeholders need to interact with and make informed decisions about using machine learning models in everyday systems. Visualization technology can support stakeholders in understanding and evaluating trade-offs between, for example, accuracy and fairness of models. This paper aims to empirically answer "Can visualization design choices affect a stakeholder's perception of model bias, trust in a model, and willingness to adopt a model?" Through a series of controlled, crowd-sourced experiments with more than 1,500 participants, we identify a set of strategies people follow in deciding which models to trust. Our results show that men and women prioritize fairness and performance differently and that visual design choices significantly affect that prioritization. For example, women trust fairer models more often than men do, participants value fairness more when it is explained using text than as a bar chart, and being explicitly told a model is biased has a bigger impact than showing past biased performance. We test the generalizability of our results by comparing the effect of multiple textual and visual design choices and offer potential explanations of the cognitive mechanisms behind the difference in fairness perception and trust. Our research guides design considerations to support future work developing visualization systems for machine learning.
title My Model is Unfair, Do People Even Care? Visual Design Affects Trust and Perceived Bias in Machine Learning
topic Human-Computer Interaction
H.5.0
url https://arxiv.org/abs/2308.03299