WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914954082254848 |
|---|---|
| author | Tang, Hao Key, Darren Ellis, Kevin |
| author_facet | Tang, Hao Key, Darren Ellis, Kevin |
| contents | We give a model-based agent that builds a Python program representing its knowledge of the world based on its interactions with the environment. The world model tries to explain its interactions, while also being optimistic about what reward it can achieve. We define this optimism as a logical constraint between a program and a planner. We study our agent on gridworlds, and on task planning, finding our approach is more sample-efficient compared to deep RL, more compute-efficient compared to ReAct-style agents, and that it can transfer its knowledge across environments by editing its code. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_12275 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment Tang, Hao Key, Darren Ellis, Kevin Artificial Intelligence Computation and Language We give a model-based agent that builds a Python program representing its knowledge of the world based on its interactions with the environment. The world model tries to explain its interactions, while also being optimistic about what reward it can achieve. We define this optimism as a logical constraint between a program and a planner. We study our agent on gridworlds, and on task planning, finding our approach is more sample-efficient compared to deep RL, more compute-efficient compared to ReAct-style agents, and that it can transfer its knowledge across environments by editing its code. |
| title | WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2402.12275 |