Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Hao, Yang, Xue, Wang, Zhaokai, Zhu, Xizhou, Zhou, Jie, Qiao, Yu, Wang, Xiaogang, Li, Hongsheng, Lu, Lewei, Dai, Jifeng
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910391927308288
author Li, Hao
Yang, Xue
Wang, Zhaokai
Zhu, Xizhou
Zhou, Jie
Qiao, Yu
Wang, Xiaogang
Li, Hongsheng
Lu, Lewei
Dai, Jifeng
author_facet Li, Hao
Yang, Xue
Wang, Zhaokai
Zhu, Xizhou
Zhou, Jie
Qiao, Yu
Wang, Xiaogang
Li, Hongsheng
Lu, Lewei
Dai, Jifeng
contents Many reinforcement learning environments (e.g., Minecraft) provide only sparse rewards that indicate task completion or failure with binary values. The challenge in exploration efficiency in such environments makes it difficult for reinforcement-learning-based agents to learn complex tasks. To address this, this paper introduces an advanced learning system, named Auto MC-Reward, that leverages Large Language Models (LLMs) to automatically design dense reward functions, thereby enhancing the learning efficiency. Auto MC-Reward consists of three important components: Reward Designer, Reward Critic, and Trajectory Analyzer. Given the environment information and task descriptions, the Reward Designer first design the reward function by coding an executable Python function with predefined observation inputs. Then, our Reward Critic will be responsible for verifying the code, checking whether the code is self-consistent and free of syntax and semantic errors. Further, the Trajectory Analyzer summarizes possible failure causes and provides refinement suggestions according to collected trajectories. In the next round, Reward Designer will further refine and iterate the dense reward function based on feedback. Experiments demonstrate a significant improvement in the success rate and learning efficiency of our agents in complex tasks in Minecraft, such as obtaining diamond with the efficient ability to avoid lava, and efficiently explore trees and animals that are sparse in the plains biome.
format Preprint
id arxiv_https___arxiv_org_abs_2312_09238
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
Li, Hao
Yang, Xue
Wang, Zhaokai
Zhu, Xizhou
Zhou, Jie
Qiao, Yu
Wang, Xiaogang
Li, Hongsheng
Lu, Lewei
Dai, Jifeng
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Machine Learning
Many reinforcement learning environments (e.g., Minecraft) provide only sparse rewards that indicate task completion or failure with binary values. The challenge in exploration efficiency in such environments makes it difficult for reinforcement-learning-based agents to learn complex tasks. To address this, this paper introduces an advanced learning system, named Auto MC-Reward, that leverages Large Language Models (LLMs) to automatically design dense reward functions, thereby enhancing the learning efficiency. Auto MC-Reward consists of three important components: Reward Designer, Reward Critic, and Trajectory Analyzer. Given the environment information and task descriptions, the Reward Designer first design the reward function by coding an executable Python function with predefined observation inputs. Then, our Reward Critic will be responsible for verifying the code, checking whether the code is self-consistent and free of syntax and semantic errors. Further, the Trajectory Analyzer summarizes possible failure causes and provides refinement suggestions according to collected trajectories. In the next round, Reward Designer will further refine and iterate the dense reward function based on feedback. Experiments demonstrate a significant improvement in the success rate and learning efficiency of our agents in complex tasks in Minecraft, such as obtaining diamond with the efficient ability to avoid lava, and efficiently explore trees and animals that are sparse in the plains biome.
title Auto MC-Reward: Automated Dense Reward Design with Large Language Models for Minecraft
topic Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2312.09238