Saved in:
Bibliographic Details
Main Authors: Gasztowtt, Henry, Smith, Benjamin, Zhu, Vincent, Bai, Qinxun, Zhang, Edwin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.08345
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914969606422528
author Gasztowtt, Henry
Smith, Benjamin
Zhu, Vincent
Bai, Qinxun
Zhang, Edwin
author_facet Gasztowtt, Henry
Smith, Benjamin
Zhu, Vincent
Bai, Qinxun
Zhang, Edwin
contents The improvement of economic policymaking presents an opportunity for broad societal benefit, a notion that has inspired research towards AI-driven policymaking tools. AI policymaking holds the potential to surpass human performance through the ability to process data quickly at scale. However, existing RL-based methods exhibit sample inefficiency, and are further limited by an inability to flexibly incorporate nuanced information into their decision-making processes. Thus, we propose a novel method in which we instead utilize pre-trained Large Language Models (LLMs), as sample-efficient policymakers in socially complex multi-agent reinforcement learning (MARL) scenarios. We demonstrate significant efficiency gains, outperforming existing methods across three environments. Our code is available at https://github.com/hegasz/large-legislative-models.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08345
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Large Legislative Models: Towards Efficient AI Policymaking in Economic Simulations
Gasztowtt, Henry
Smith, Benjamin
Zhu, Vincent
Bai, Qinxun
Zhang, Edwin
Artificial Intelligence
The improvement of economic policymaking presents an opportunity for broad societal benefit, a notion that has inspired research towards AI-driven policymaking tools. AI policymaking holds the potential to surpass human performance through the ability to process data quickly at scale. However, existing RL-based methods exhibit sample inefficiency, and are further limited by an inability to flexibly incorporate nuanced information into their decision-making processes. Thus, we propose a novel method in which we instead utilize pre-trained Large Language Models (LLMs), as sample-efficient policymakers in socially complex multi-agent reinforcement learning (MARL) scenarios. We demonstrate significant efficiency gains, outperforming existing methods across three environments. Our code is available at https://github.com/hegasz/large-legislative-models.
title Large Legislative Models: Towards Efficient AI Policymaking in Economic Simulations
topic Artificial Intelligence
url https://arxiv.org/abs/2410.08345