AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929697389019136 |
|---|---|
| author | Schoeffer, Jakob Jakubik, Johannes Voessing, Michael Kuehl, Niklas Satzger, Gerhard |
| author_facet | Schoeffer, Jakob Jakubik, Johannes Voessing, Michael Kuehl, Niklas Satzger, Gerhard |
| contents | In AI-assisted decision-making, a central promise of having a human-in-the-loop is that they should be able to complement the AI system by overriding its wrong recommendations. In practice, however, we often see that humans cannot assess the correctness of AI recommendations and, as a result, adhere to wrong or override correct advice. Different ways of relying on AI recommendations have immediate, yet distinct, implications for decision quality. Unfortunately, reliance and decision quality are often inappropriately conflated in the current literature on AI-assisted decision-making. In this work, we disentangle and formalize the relationship between reliance and decision quality, and we characterize the conditions under which human-AI complementarity is achievable. To illustrate how reliance and decision quality relate to one another, we propose a visual framework and demonstrate its usefulness for interpreting empirical findings, including the effects of interventions like explanations. Overall, our research highlights the importance of distinguishing between reliance behavior and decision quality in AI-assisted decision-making. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2304_08804 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventions Schoeffer, Jakob Jakubik, Johannes Voessing, Michael Kuehl, Niklas Satzger, Gerhard Human-Computer Interaction Artificial Intelligence In AI-assisted decision-making, a central promise of having a human-in-the-loop is that they should be able to complement the AI system by overriding its wrong recommendations. In practice, however, we often see that humans cannot assess the correctness of AI recommendations and, as a result, adhere to wrong or override correct advice. Different ways of relying on AI recommendations have immediate, yet distinct, implications for decision quality. Unfortunately, reliance and decision quality are often inappropriately conflated in the current literature on AI-assisted decision-making. In this work, we disentangle and formalize the relationship between reliance and decision quality, and we characterize the conditions under which human-AI complementarity is achievable. To illustrate how reliance and decision quality relate to one another, we propose a visual framework and demonstrate its usefulness for interpreting empirical findings, including the effects of interventions like explanations. Overall, our research highlights the importance of distinguishing between reliance behavior and decision quality in AI-assisted decision-making. |
| title | AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventions |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2304.08804 |