Who is a Better Player: LLM against LLM
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915433138880512 |
|---|---|
| author | Zhou, Yingjie Cao, Jiezhang Wen, Farong Xu, Li Jiang, Yanwei Jia, Jun Li, Ronghui Liu, Xiaohong Zhou, Yu Min, Xiongkuo Guo, Jie Zhang, Zicheng Zhai, Guangtao |
| author_facet | Zhou, Yingjie Cao, Jiezhang Wen, Farong Xu, Li Jiang, Yanwei Jia, Jun Li, Ronghui Liu, Xiaohong Zhou, Yu Min, Xiongkuo Guo, Jie Zhang, Zicheng Zhai, Guangtao |
| contents | Adversarial board games, as a paradigmatic domain of strategic reasoning and intelligence, have long served as both a popular competitive activity and a benchmark for evaluating artificial intelligence (AI) systems. Building on this foundation, we propose an adversarial benchmarking framework to assess the comprehensive performance of Large Language Models (LLMs) through board games competition, compensating the limitation of data dependency of the mainstream Question-and-Answer (Q&A) based benchmark method. We introduce Qi Town, a specialized evaluation platform that supports 5 widely played games and involves 20 LLM-driven players. The platform employs both the Elo rating system and a novel Performance Loop Graph (PLG) to quantitatively evaluate the technical capabilities of LLMs, while also capturing Positive Sentiment Score (PSS) throughout gameplay to assess mental fitness. The evaluation is structured as a round-robin tournament, enabling systematic comparison across players. Experimental results indicate that, despite technical differences, most LLMs remain optimistic about winning and losing, demonstrating greater adaptability to high-stress adversarial environments than humans. On the other hand, the complex relationship between cyclic wins and losses in PLGs exposes the instability of LLMs' skill play during games, warranting further explanation and exploration. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_04720 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Who is a Better Player: LLM against LLM Zhou, Yingjie Cao, Jiezhang Wen, Farong Xu, Li Jiang, Yanwei Jia, Jun Li, Ronghui Liu, Xiaohong Zhou, Yu Min, Xiongkuo Guo, Jie Zhang, Zicheng Zhai, Guangtao Artificial Intelligence Adversarial board games, as a paradigmatic domain of strategic reasoning and intelligence, have long served as both a popular competitive activity and a benchmark for evaluating artificial intelligence (AI) systems. Building on this foundation, we propose an adversarial benchmarking framework to assess the comprehensive performance of Large Language Models (LLMs) through board games competition, compensating the limitation of data dependency of the mainstream Question-and-Answer (Q&A) based benchmark method. We introduce Qi Town, a specialized evaluation platform that supports 5 widely played games and involves 20 LLM-driven players. The platform employs both the Elo rating system and a novel Performance Loop Graph (PLG) to quantitatively evaluate the technical capabilities of LLMs, while also capturing Positive Sentiment Score (PSS) throughout gameplay to assess mental fitness. The evaluation is structured as a round-robin tournament, enabling systematic comparison across players. Experimental results indicate that, despite technical differences, most LLMs remain optimistic about winning and losing, demonstrating greater adaptability to high-stress adversarial environments than humans. On the other hand, the complex relationship between cyclic wins and losses in PLGs exposes the instability of LLMs' skill play during games, warranting further explanation and exploration. |
| title | Who is a Better Player: LLM against LLM |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2508.04720 |