Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Guo, Jiaxian, Yang, Bo, Yoo, Paul, Lin, Bill Yuchen, Iwasawa, Yusuke, Matsuo, Yutaka
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910584844320768
author Guo, Jiaxian
Yang, Bo
Yoo, Paul
Lin, Bill Yuchen
Iwasawa, Yusuke
Matsuo, Yutaka
author_facet Guo, Jiaxian
Yang, Bo
Yoo, Paul
Lin, Bill Yuchen
Iwasawa, Yusuke
Matsuo, Yutaka
contents Unlike perfect information games, where all elements are known to every player, imperfect information games emulate the real-world complexities of decision-making under uncertain or incomplete information. GPT-4, the recent breakthrough in large language models (LLMs) trained on massive passive data, is notable for its knowledge retrieval and reasoning abilities. This paper delves into the applicability of GPT-4's learned knowledge for imperfect information games. To achieve this, we introduce \textbf{Suspicion-Agent}, an innovative agent that leverages GPT-4's capabilities for performing in imperfect information games. With proper prompt engineering to achieve different functions, Suspicion-Agent based on GPT-4 demonstrates remarkable adaptability across a range of imperfect information card games. Importantly, GPT-4 displays a strong high-order theory of mind (ToM) capacity, meaning it can understand others and intentionally impact others' behavior. Leveraging this, we design a planning strategy that enables GPT-4 to competently play against different opponents, adapting its gameplay style as needed, while requiring only the game rules and descriptions of observations as input. In the experiments, we qualitatively showcase the capabilities of Suspicion-Agent across three different imperfect information games and then quantitatively evaluate it in Leduc Hold'em. The results show that Suspicion-Agent can potentially outperform traditional algorithms designed for imperfect information games, without any specialized training or examples. In order to encourage and foster deeper insights within the community, we make our game-related data publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2309_17277
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4
Guo, Jiaxian
Yang, Bo
Yoo, Paul
Lin, Bill Yuchen
Iwasawa, Yusuke
Matsuo, Yutaka
Artificial Intelligence
Unlike perfect information games, where all elements are known to every player, imperfect information games emulate the real-world complexities of decision-making under uncertain or incomplete information. GPT-4, the recent breakthrough in large language models (LLMs) trained on massive passive data, is notable for its knowledge retrieval and reasoning abilities. This paper delves into the applicability of GPT-4's learned knowledge for imperfect information games. To achieve this, we introduce \textbf{Suspicion-Agent}, an innovative agent that leverages GPT-4's capabilities for performing in imperfect information games. With proper prompt engineering to achieve different functions, Suspicion-Agent based on GPT-4 demonstrates remarkable adaptability across a range of imperfect information card games. Importantly, GPT-4 displays a strong high-order theory of mind (ToM) capacity, meaning it can understand others and intentionally impact others' behavior. Leveraging this, we design a planning strategy that enables GPT-4 to competently play against different opponents, adapting its gameplay style as needed, while requiring only the game rules and descriptions of observations as input. In the experiments, we qualitatively showcase the capabilities of Suspicion-Agent across three different imperfect information games and then quantitatively evaluate it in Leduc Hold'em. The results show that Suspicion-Agent can potentially outperform traditional algorithms designed for imperfect information games, without any specialized training or examples. In order to encourage and foster deeper insights within the community, we make our game-related data publicly available.
title Suspicion-Agent: Playing Imperfect Information Games with Theory of Mind Aware GPT-4
topic Artificial Intelligence
url https://arxiv.org/abs/2309.17277