DynaSaur: Large Language Agents Beyond Predefined Actions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nguyen, Dang, Lai, Viet Dac, Yoon, Seunghyun, Rossi, Ryan A., Zhao, Handong, Zhang, Ruiyi, Mathur, Puneet, Lipka, Nedim, Wang, Yu, Bui, Trung, Dernoncourt, Franck, Zhou, Tianyi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909769469526016
author Nguyen, Dang
Lai, Viet Dac
Yoon, Seunghyun
Rossi, Ryan A.
Zhao, Handong
Zhang, Ruiyi
Mathur, Puneet
Lipka, Nedim
Wang, Yu
Bui, Trung
Dernoncourt, Franck
Zhou, Tianyi
author_facet Nguyen, Dang
Lai, Viet Dac
Yoon, Seunghyun
Rossi, Ryan A.
Zhao, Handong
Zhang, Ruiyi
Mathur, Puneet
Lipka, Nedim
Wang, Yu
Bui, Trung
Dernoncourt, Franck
Zhou, Tianyi
contents Existing LLM agent systems typically select actions from a fixed and predefined set at every step. While this approach is effective in closed, narrowly scoped environments, it presents two major challenges for real-world, open-ended scenarios: (1) it significantly restricts the planning and acting capabilities of LLM agents, and (2) it requires substantial human effort to enumerate and implement all possible actions, which is impractical in complex environments with a vast number of potential actions. To address these limitations, we propose an LLM agent framework that can dynamically create and compose actions as needed. In this framework, the agent interacts with its environment by generating and executing programs written in a general-purpose programming language. Moreover, generated actions are accumulated over time for future reuse. Our extensive experiments across multiple benchmarks show that this framework significantly improves flexibility and outperforms prior methods that rely on a fixed action set. Notably, it enables LLM agents to adapt and recover in scenarios where predefined actions are insufficient or fail due to unforeseen edge cases. Our code can be found in https://github.com/adobe-research/dynasaur.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01747
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DynaSaur: Large Language Agents Beyond Predefined Actions
Nguyen, Dang
Lai, Viet Dac
Yoon, Seunghyun
Rossi, Ryan A.
Zhao, Handong
Zhang, Ruiyi
Mathur, Puneet
Lipka, Nedim
Wang, Yu
Bui, Trung
Dernoncourt, Franck
Zhou, Tianyi
Computation and Language
Existing LLM agent systems typically select actions from a fixed and predefined set at every step. While this approach is effective in closed, narrowly scoped environments, it presents two major challenges for real-world, open-ended scenarios: (1) it significantly restricts the planning and acting capabilities of LLM agents, and (2) it requires substantial human effort to enumerate and implement all possible actions, which is impractical in complex environments with a vast number of potential actions. To address these limitations, we propose an LLM agent framework that can dynamically create and compose actions as needed. In this framework, the agent interacts with its environment by generating and executing programs written in a general-purpose programming language. Moreover, generated actions are accumulated over time for future reuse. Our extensive experiments across multiple benchmarks show that this framework significantly improves flexibility and outperforms prior methods that rely on a fixed action set. Notably, it enables LLM agents to adapt and recover in scenarios where predefined actions are insufficient or fail due to unforeseen edge cases. Our code can be found in https://github.com/adobe-research/dynasaur.
title DynaSaur: Large Language Agents Beyond Predefined Actions
topic Computation and Language
url https://arxiv.org/abs/2411.01747