Towards Lifelong Dialogue Agents via Timeline-based Memory Management
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916588281659392 |
|---|---|
| author | Ong, Kai Tzu-iunn Kim, Namyoung Gwak, Minju Chae, Hyungjoo Kwon, Taeyoon Jo, Yohan Hwang, Seung-won Lee, Dongha Yeo, Jinyoung |
| author_facet | Ong, Kai Tzu-iunn Kim, Namyoung Gwak, Minju Chae, Hyungjoo Kwon, Taeyoon Jo, Yohan Hwang, Seung-won Lee, Dongha Yeo, Jinyoung |
| contents | To achieve lifelong human-agent interaction, dialogue agents need to constantly memorize perceived information and properly retrieve it for response generation (RG). While prior studies focus on getting rid of outdated memories to improve retrieval quality, we argue that such memories provide rich, important contextual cues for RG (e.g., changes in user behaviors) in long-term conversations. We present THEANINE, a framework for LLM-based lifelong dialogue agents. THEANINE discards memory removal and manages large-scale memories by linking them based on their temporal and cause-effect relation. Enabled by this linking structure, THEANINE augments RG with memory timelines - series of memories representing the evolution or causality of relevant past events. Along with THEANINE, we introduce TeaFarm, a counterfactual-driven evaluation scheme, addressing the limitation of G-Eval and human efforts when assessing agent performance in integrating past memories into RG. A supplementary video for THEANINE and data for TeaFarm are at https://huggingface.co/spaces/ResearcherScholar/Theanine. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_10996 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Lifelong Dialogue Agents via Timeline-based Memory Management Ong, Kai Tzu-iunn Kim, Namyoung Gwak, Minju Chae, Hyungjoo Kwon, Taeyoon Jo, Yohan Hwang, Seung-won Lee, Dongha Yeo, Jinyoung Computation and Language To achieve lifelong human-agent interaction, dialogue agents need to constantly memorize perceived information and properly retrieve it for response generation (RG). While prior studies focus on getting rid of outdated memories to improve retrieval quality, we argue that such memories provide rich, important contextual cues for RG (e.g., changes in user behaviors) in long-term conversations. We present THEANINE, a framework for LLM-based lifelong dialogue agents. THEANINE discards memory removal and manages large-scale memories by linking them based on their temporal and cause-effect relation. Enabled by this linking structure, THEANINE augments RG with memory timelines - series of memories representing the evolution or causality of relevant past events. Along with THEANINE, we introduce TeaFarm, a counterfactual-driven evaluation scheme, addressing the limitation of G-Eval and human efforts when assessing agent performance in integrating past memories into RG. A supplementary video for THEANINE and data for TeaFarm are at https://huggingface.co/spaces/ResearcherScholar/Theanine. |
| title | Towards Lifelong Dialogue Agents via Timeline-based Memory Management |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.10996 |