Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.12362 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915068771303424 |
|---|---|
| author | Xie, Yutong Liu, Yiyao Ma, Zhuang Shi, Lin Wang, Xiyuan Yuan, Walter Jackson, Matthew O. Mei, Qiaozhu |
| author_facet | Xie, Yutong Liu, Yiyao Ma, Zhuang Shi, Lin Wang, Xiyuan Yuan, Walter Jackson, Matthew O. Mei, Qiaozhu |
| contents | The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplement to a recent study on the behavioral Turing test, this paper presents a comprehensive analysis of five leading LLM-based chatbot families as they navigate a series of behavioral economics games. By benchmarking these AI chatbots, we aim to uncover and document both common and distinct behavioral patterns across a range of scenarios. The findings provide valuable insights into the strategic preferences of each LLM, highlighting potential implications for their deployment in critical decision-making roles. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_12362 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games Xie, Yutong Liu, Yiyao Ma, Zhuang Shi, Lin Wang, Xiyuan Yuan, Walter Jackson, Matthew O. Mei, Qiaozhu Artificial Intelligence Computation and Language The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplement to a recent study on the behavioral Turing test, this paper presents a comprehensive analysis of five leading LLM-based chatbot families as they navigate a series of behavioral economics games. By benchmarking these AI chatbots, we aim to uncover and document both common and distinct behavioral patterns across a range of scenarios. The findings provide valuable insights into the strategic preferences of each LLM, highlighting potential implications for their deployment in critical decision-making roles. |
| title | How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2412.12362 |