Revealing AI Reasoning Increases Trust but Crowds Out Unique Human Knowledge

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Zenan, Gao, Ruijiang, Liang, Yingzhi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918188227231744
author Chen, Zenan
Gao, Ruijiang
Liang, Yingzhi
author_facet Chen, Zenan
Gao, Ruijiang
Liang, Yingzhi
contents Effective human-AI collaboration requires humans to accurately gauge AI capabilities and calibrate their trust accordingly. Humans often have context-dependent private information, referred to as Unique Human Knowledge (UHK), that is crucial for deciding whether to accept or override AI's recommendations. We examine how displaying AI reasoning affects trust and UHK utilization through a pre-registered, incentive-compatible experiment (N = 752). We find that revealing AI reasoning, whether brief or extensive, acts as a powerful persuasive heuristic that significantly increases trust and agreement with AI recommendations. Rather than helping participants appropriately calibrate their trust, this transparency induces over-trust that crowds out UHK utilization. Our results highlight the need for careful consideration when revealing AI reasoning and call for better information design in human-AI collaboration systems.
format Preprint
id arxiv_https___arxiv_org_abs_2511_04050
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Revealing AI Reasoning Increases Trust but Crowds Out Unique Human Knowledge
Chen, Zenan
Gao, Ruijiang
Liang, Yingzhi
Human-Computer Interaction
Effective human-AI collaboration requires humans to accurately gauge AI capabilities and calibrate their trust accordingly. Humans often have context-dependent private information, referred to as Unique Human Knowledge (UHK), that is crucial for deciding whether to accept or override AI's recommendations. We examine how displaying AI reasoning affects trust and UHK utilization through a pre-registered, incentive-compatible experiment (N = 752). We find that revealing AI reasoning, whether brief or extensive, acts as a powerful persuasive heuristic that significantly increases trust and agreement with AI recommendations. Rather than helping participants appropriately calibrate their trust, this transparency induces over-trust that crowds out UHK utilization. Our results highlight the need for careful consideration when revealing AI reasoning and call for better information design in human-AI collaboration systems.
title Revealing AI Reasoning Increases Trust but Crowds Out Unique Human Knowledge
topic Human-Computer Interaction
url https://arxiv.org/abs/2511.04050