Should XAI Nudge Human Decisions with Explanation Biasing?

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fukuchi, Yosuke, Yamada, Seiji
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914831726018560
author Fukuchi, Yosuke
Yamada, Seiji
author_facet Fukuchi, Yosuke
Yamada, Seiji
contents This paper reviews our previous trials of Nudge-XAI, an approach that introduces automatic biases into explanations from explainable AIs (XAIs) with the aim of leading users to better decisions, and it discusses the benefits and challenges. Nudge-XAI uses a user model that predicts the influence of providing an explanation or emphasizing it and attempts to guide users toward AI-suggested decisions without coercion. The nudge design is expected to enhance the autonomy of users, reduce the risk associated with an AI making decisions without users' full agreement, and enable users to avoid AI failures. To discuss the potential of Nudge-XAI, this paper reports a post-hoc investigation of previous experimental results using cluster analysis. The results demonstrate the diversity of user behavior in response to Nudge-XAI, which supports our aim of enhancing user autonomy. However, it also highlights the challenge of users who distrust AI and falsely make decisions contrary to AI suggestions, suggesting the need for personalized adjustment of the strength of nudges to make this approach work more generally.
format Preprint
id arxiv_https___arxiv_org_abs_2406_07323
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Should XAI Nudge Human Decisions with Explanation Biasing?
Fukuchi, Yosuke
Yamada, Seiji
Human-Computer Interaction
Artificial Intelligence
This paper reviews our previous trials of Nudge-XAI, an approach that introduces automatic biases into explanations from explainable AIs (XAIs) with the aim of leading users to better decisions, and it discusses the benefits and challenges. Nudge-XAI uses a user model that predicts the influence of providing an explanation or emphasizing it and attempts to guide users toward AI-suggested decisions without coercion. The nudge design is expected to enhance the autonomy of users, reduce the risk associated with an AI making decisions without users' full agreement, and enable users to avoid AI failures. To discuss the potential of Nudge-XAI, this paper reports a post-hoc investigation of previous experimental results using cluster analysis. The results demonstrate the diversity of user behavior in response to Nudge-XAI, which supports our aim of enhancing user autonomy. However, it also highlights the challenge of users who distrust AI and falsely make decisions contrary to AI suggestions, suggesting the need for personalized adjustment of the strength of nudges to make this approach work more generally.
title Should XAI Nudge Human Decisions with Explanation Biasing?
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2406.07323