Not All Trust is the Same: Effects of Decision Workflow and Explanations in Human-AI Decision Making

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Spillner, Laura, Ringe, Rachel, Porzel, Robert, Malaka, Rainer
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914371933831168
author Spillner, Laura
Ringe, Rachel
Porzel, Robert
Malaka, Rainer
author_facet Spillner, Laura
Ringe, Rachel
Porzel, Robert
Malaka, Rainer
contents A central challenge in AI-assisted decision making is achieving warranted, well-calibrated trust. Both overtrust (accepting incorrect AI recommendations) and undertrust (rejecting correct advice) should be prevented. Prior studies differ in the design of the decision workflow - whether users see the AI suggestion immediately (1-step setup) or have to submit a first decision beforehand (2-step setup) -, and in how trust is measured - through self-reports or as behavioral trust, that is, reliance. We examined the effects and interactions of (a) the type of decision workflow, (b) the presence of explanations, and (c) users' domain knowledge and prior AI experience. We compared reported trust, reliance (agreement rate and switch rate), and overreliance. Results showed no evidence that a 2-step setup reduces overreliance. The decision workflow also did not directly affect self-reported trust, but there was a crossover interaction effect with domain knowledge and explanations, suggesting that the effects of explanations alone may not generalize across workflow setups. Finally, our findings confirm that reported trust and reliance behavior are distinct constructs that should be evaluated separately in AI-assisted decision making.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05229
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Not All Trust is the Same: Effects of Decision Workflow and Explanations in Human-AI Decision Making
Spillner, Laura
Ringe, Rachel
Porzel, Robert
Malaka, Rainer
Human-Computer Interaction
Artificial Intelligence
A central challenge in AI-assisted decision making is achieving warranted, well-calibrated trust. Both overtrust (accepting incorrect AI recommendations) and undertrust (rejecting correct advice) should be prevented. Prior studies differ in the design of the decision workflow - whether users see the AI suggestion immediately (1-step setup) or have to submit a first decision beforehand (2-step setup) -, and in how trust is measured - through self-reports or as behavioral trust, that is, reliance. We examined the effects and interactions of (a) the type of decision workflow, (b) the presence of explanations, and (c) users' domain knowledge and prior AI experience. We compared reported trust, reliance (agreement rate and switch rate), and overreliance. Results showed no evidence that a 2-step setup reduces overreliance. The decision workflow also did not directly affect self-reported trust, but there was a crossover interaction effect with domain knowledge and explanations, suggesting that the effects of explanations alone may not generalize across workflow setups. Finally, our findings confirm that reported trust and reliance behavior are distinct constructs that should be evaluated separately in AI-assisted decision making.
title Not All Trust is the Same: Effects of Decision Workflow and Explanations in Human-AI Decision Making
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2603.05229