Verification Required: The Impact of Information Credibility on AI Persuasion

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Mahmud, Saaduddin, Bagdasarian, Eugene, Zilberstein, Shlomo
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910007631544320
author Mahmud, Saaduddin
Bagdasarian, Eugene
Zilberstein, Shlomo
author_facet Mahmud, Saaduddin
Bagdasarian, Eugene
Zilberstein, Shlomo
contents Agents powered by large language models (LLMs) are increasingly deployed in settings where communication shapes high-stakes decisions, making a principled understanding of strategic communication essential. Prior work largely studies either unverifiable cheap-talk or fully verifiable disclosure, failing to capture realistic domains in which information has probabilistic credibility. We introduce MixTalk, a strategic communication game for LLM-to-LLM interaction that models information credibility. In MixTalk, a sender agent strategically combines verifiable and unverifiable claims to communicate private information, while a receiver agent allocates a limited budget to costly verification and infers the underlying state from prior beliefs, claims, and verification outcomes. We evaluate state-of-the-art LLM agents in large-scale tournaments across three realistic deployment settings, revealing their strengths and limitations in reasoning about information credibility and the explicit behavior that shapes these interactions. Finally, we propose Tournament Oracle Policy Distillation (TOPD), an offline method that distills tournament oracle policy from interaction logs and deploys it in-context at inference time. Our results show that TOPD significantly improves receiver robustness to persuasion.
format Preprint
id arxiv_https___arxiv_org_abs_2602_00970
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Verification Required: The Impact of Information Credibility on AI Persuasion
Mahmud, Saaduddin
Bagdasarian, Eugene
Zilberstein, Shlomo
Computation and Language
Computer Science and Game Theory
Agents powered by large language models (LLMs) are increasingly deployed in settings where communication shapes high-stakes decisions, making a principled understanding of strategic communication essential. Prior work largely studies either unverifiable cheap-talk or fully verifiable disclosure, failing to capture realistic domains in which information has probabilistic credibility. We introduce MixTalk, a strategic communication game for LLM-to-LLM interaction that models information credibility. In MixTalk, a sender agent strategically combines verifiable and unverifiable claims to communicate private information, while a receiver agent allocates a limited budget to costly verification and infers the underlying state from prior beliefs, claims, and verification outcomes. We evaluate state-of-the-art LLM agents in large-scale tournaments across three realistic deployment settings, revealing their strengths and limitations in reasoning about information credibility and the explicit behavior that shapes these interactions. Finally, we propose Tournament Oracle Policy Distillation (TOPD), an offline method that distills tournament oracle policy from interaction logs and deploys it in-context at inference time. Our results show that TOPD significantly improves receiver robustness to persuasion.
title Verification Required: The Impact of Information Credibility on AI Persuasion
topic Computation and Language
Computer Science and Game Theory
url https://arxiv.org/abs/2602.00970