AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915287437148160 |
|---|---|
| author | Anokhin, Petr Semenov, Nikita Sorokin, Artyom Evseev, Dmitry Kravchenko, Andrey Burtsev, Mikhail Burnaev, Evgeny |
| author_facet | Anokhin, Petr Semenov, Nikita Sorokin, Artyom Evseev, Dmitry Kravchenko, Andrey Burtsev, Mikhail Burnaev, Evgeny |
| contents | Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and updating their knowledge. Current LLM-based agents process past experiences using a full history of observations, summarization, retrieval augmentation. However, these unstructured memory representations do not facilitate the reasoning and planning essential for complex decision-making. In our study, we introduce AriGraph, a novel method wherein the agent constructs and updates a memory graph that integrates semantic and episodic memories while exploring the environment. We demonstrate that our Ariadne LLM agent, consisting of the proposed memory architecture augmented with planning and decision-making, effectively handles complex tasks within interactive text game environments difficult even for human players. Results show that our approach markedly outperforms other established memory methods and strong RL baselines in a range of problems of varying complexity. Additionally, AriGraph demonstrates competitive performance compared to dedicated knowledge graph-based methods in static multi-hop question-answering. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_04363 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents Anokhin, Petr Semenov, Nikita Sorokin, Artyom Evseev, Dmitry Kravchenko, Andrey Burtsev, Mikhail Burnaev, Evgeny Artificial Intelligence Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and updating their knowledge. Current LLM-based agents process past experiences using a full history of observations, summarization, retrieval augmentation. However, these unstructured memory representations do not facilitate the reasoning and planning essential for complex decision-making. In our study, we introduce AriGraph, a novel method wherein the agent constructs and updates a memory graph that integrates semantic and episodic memories while exploring the environment. We demonstrate that our Ariadne LLM agent, consisting of the proposed memory architecture augmented with planning and decision-making, effectively handles complex tasks within interactive text game environments difficult even for human players. Results show that our approach markedly outperforms other established memory methods and strong RL baselines in a range of problems of varying complexity. Additionally, AriGraph demonstrates competitive performance compared to dedicated knowledge graph-based methods in static multi-hop question-answering. |
| title | AriGraph: Learning Knowledge Graph World Models with Episodic Memory for LLM Agents |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2407.04363 |