Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.13167 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914957535215616 |
|---|---|
| author | Wang, Bo Huang, Heyan Cao, Yixin Ying, Jiahao Tang, Wei Feng, Chong |
| author_facet | Wang, Bo Huang, Heyan Cao, Yixin Ying, Jiahao Tang, Wei Feng, Chong |
| contents | While large language models (LLMs) have made notable advancements in natural language processing, they continue to struggle with processing extensive text. Memory mechanism offers a flexible solution for managing long contexts, utilizing techniques such as compression, summarization, and structuring to facilitate nuanced and efficient handling of large volumes of text. However, existing techniques face challenges with static knowledge integration, leading to insufficient adaptation to task-specific needs and missing multi-segmentation relationships, which hinders the dynamic reorganization and logical combination of relevant segments during the response process. To address these issues, we introduce a novel strategy, Question then Reflection Memory Mechanism (QRMeM), incorporating a dual-structured memory pool. This pool synergizes static textual content with structured graph guidance, fostering a reflective trial-and-error approach for navigating and identifying relevant segments. Our evaluation across multiple-choice questions (MCQ) and multi-document question answering (Multi-doc QA) benchmarks showcases QRMeM enhanced performance compared to existing approaches. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_13167 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism Wang, Bo Huang, Heyan Cao, Yixin Ying, Jiahao Tang, Wei Feng, Chong Computation and Language While large language models (LLMs) have made notable advancements in natural language processing, they continue to struggle with processing extensive text. Memory mechanism offers a flexible solution for managing long contexts, utilizing techniques such as compression, summarization, and structuring to facilitate nuanced and efficient handling of large volumes of text. However, existing techniques face challenges with static knowledge integration, leading to insufficient adaptation to task-specific needs and missing multi-segmentation relationships, which hinders the dynamic reorganization and logical combination of relevant segments during the response process. To address these issues, we introduce a novel strategy, Question then Reflection Memory Mechanism (QRMeM), incorporating a dual-structured memory pool. This pool synergizes static textual content with structured graph guidance, fostering a reflective trial-and-error approach for navigating and identifying relevant segments. Our evaluation across multiple-choice questions (MCQ) and multi-document question answering (Multi-doc QA) benchmarks showcases QRMeM enhanced performance compared to existing approaches. |
| title | QRMeM: Unleash the Length Limitation through Question then Reflection Memory Mechanism |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2406.13167 |