Humans incorrectly reject confident accusatory AI judgments

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Loconte, Riccardo, Monaro, Merylin, Pietrini, Pietro, Verschuere, Bruno, Kleinberg, Bennett
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908948588658688
author Loconte, Riccardo
Monaro, Merylin
Pietrini, Pietro
Verschuere, Bruno
Kleinberg, Bennett
author_facet Loconte, Riccardo
Monaro, Merylin
Pietrini, Pietro
Verschuere, Bruno
Kleinberg, Bennett
contents Automated verbal deception detection using methods from Artificial Intelligence (AI) has been shown to outperform humans in disentangling lies from truths. Research suggests that transparency and interpretability of computational methods tend to increase human acceptance of using AI to support decisions. However, the extent to which humans accept AI judgments for deception detection remains unclear. We experimentally examined how an AI model's accuracy (i.e., its overall performance in deception detection) and confidence (i.e., the model's uncertainty in single-statements predictions) influence human adoption of the model's judgments. Participants (n=373) were presented with veracity judgments of an AI model with high or low overall accuracy and various degrees of prediction confidence. The results showed that humans followed predictions from a highly accurate model more than from a less accurate one. Interestingly, the more confident the model, the more people deviated from it, especially if the model predicted deception. We also found that human interaction with algorithmic predictions either worsened the machine's performance or was ineffective. While this human aversion to accept highly confident algorithmic predictions was partly explained by participants' tendency to overestimate humans' deception detection abilities, we also discuss how truth-default theory and the social costs of accusing someone of lying help explain the findings.
format Preprint
id arxiv_https___arxiv_org_abs_2512_02848
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Humans incorrectly reject confident accusatory AI judgments
Loconte, Riccardo
Monaro, Merylin
Pietrini, Pietro
Verschuere, Bruno
Kleinberg, Bennett
Human-Computer Interaction
Automated verbal deception detection using methods from Artificial Intelligence (AI) has been shown to outperform humans in disentangling lies from truths. Research suggests that transparency and interpretability of computational methods tend to increase human acceptance of using AI to support decisions. However, the extent to which humans accept AI judgments for deception detection remains unclear. We experimentally examined how an AI model's accuracy (i.e., its overall performance in deception detection) and confidence (i.e., the model's uncertainty in single-statements predictions) influence human adoption of the model's judgments. Participants (n=373) were presented with veracity judgments of an AI model with high or low overall accuracy and various degrees of prediction confidence. The results showed that humans followed predictions from a highly accurate model more than from a less accurate one. Interestingly, the more confident the model, the more people deviated from it, especially if the model predicted deception. We also found that human interaction with algorithmic predictions either worsened the machine's performance or was ineffective. While this human aversion to accept highly confident algorithmic predictions was partly explained by participants' tendency to overestimate humans' deception detection abilities, we also discuss how truth-default theory and the social costs of accusing someone of lying help explain the findings.
title Humans incorrectly reject confident accusatory AI judgments
topic Human-Computer Interaction
url https://arxiv.org/abs/2512.02848