Human-Agent Cooperation in Games under Incomplete Information through Natural Language Communication

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Shenghui, Fried, Daniel, Topcu, Ufuk
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911898213023744
author Chen, Shenghui
Fried, Daniel
Topcu, Ufuk
author_facet Chen, Shenghui
Fried, Daniel
Topcu, Ufuk
contents Developing autonomous agents that can strategize and cooperate with humans under information asymmetry is challenging without effective communication in natural language. We introduce a shared-control game, where two players collectively control a token in alternating turns to achieve a common objective under incomplete information. We formulate a policy synthesis problem for an autonomous agent in this game with a human as the other player. To solve this problem, we propose a communication-based approach comprising a language module and a planning module. The language module translates natural language messages into and from a finite set of flags, a compact representation defined to capture player intents. The planning module leverages these flags to compute a policy using an asymmetric information-set Monte Carlo tree search with flag exchange algorithm we present. We evaluate the effectiveness of this approach in a testbed based on Gnomes at Night, a search-and-find maze board game. Results of human subject experiments show that communication narrows the information gap between players and enhances human-agent cooperation efficiency with fewer turns.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14173
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Human-Agent Cooperation in Games under Incomplete Information through Natural Language Communication
Chen, Shenghui
Fried, Daniel
Topcu, Ufuk
Artificial Intelligence
Human-Computer Interaction
Developing autonomous agents that can strategize and cooperate with humans under information asymmetry is challenging without effective communication in natural language. We introduce a shared-control game, where two players collectively control a token in alternating turns to achieve a common objective under incomplete information. We formulate a policy synthesis problem for an autonomous agent in this game with a human as the other player. To solve this problem, we propose a communication-based approach comprising a language module and a planning module. The language module translates natural language messages into and from a finite set of flags, a compact representation defined to capture player intents. The planning module leverages these flags to compute a policy using an asymmetric information-set Monte Carlo tree search with flag exchange algorithm we present. We evaluate the effectiveness of this approach in a testbed based on Gnomes at Night, a search-and-find maze board game. Results of human subject experiments show that communication narrows the information gap between players and enhances human-agent cooperation efficiency with fewer turns.
title Human-Agent Cooperation in Games under Incomplete Information through Natural Language Communication
topic Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2405.14173