Self-Evolving GPT: A Lifelong Autonomous Experiential Learner
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917720230985728 |
|---|---|
| author | Gao, Jinglong Ding, Xiao Cui, Yiming Zhao, Jianbai Wang, Hepeng Liu, Ting Qin, Bing |
| author_facet | Gao, Jinglong Ding, Xiao Cui, Yiming Zhao, Jianbai Wang, Hepeng Liu, Ting Qin, Bing |
| contents | To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task, which is not feasible for the growing demand for LLMs and the variety of user questions. To address this issue, we design a lifelong autonomous experiential learning framework based on LLMs to explore whether LLMs can imitate human ability for learning and utilizing experience. It autonomously learns and accumulates experience through experience transfer and induction, categorizing the types of input questions to select which accumulated experience to employ for them. Experimental results on six widely used NLP datasets show that our framework performs reliably in each intermediate step and effectively improves the performance of GPT-3.5 and GPT-4. This validates the feasibility of using LLMs to mimic human experiential learning and application capabilities. Additionally, we provide a detailed analysis of the behavior of our framework at each step. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_08937 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Self-Evolving GPT: A Lifelong Autonomous Experiential Learner Gao, Jinglong Ding, Xiao Cui, Yiming Zhao, Jianbai Wang, Hepeng Liu, Ting Qin, Bing Computation and Language Artificial Intelligence To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task, which is not feasible for the growing demand for LLMs and the variety of user questions. To address this issue, we design a lifelong autonomous experiential learning framework based on LLMs to explore whether LLMs can imitate human ability for learning and utilizing experience. It autonomously learns and accumulates experience through experience transfer and induction, categorizing the types of input questions to select which accumulated experience to employ for them. Experimental results on six widely used NLP datasets show that our framework performs reliably in each intermediate step and effectively improves the performance of GPT-3.5 and GPT-4. This validates the feasibility of using LLMs to mimic human experiential learning and application capabilities. Additionally, we provide a detailed analysis of the behavior of our framework at each step. |
| title | Self-Evolving GPT: A Lifelong Autonomous Experiential Learner |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2407.08937 |