Continual Learning for Large Language Models: A Survey
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929235686326272 |
|---|---|
| author | Wu, Tongtong Luo, Linhao Li, Yuan-Fang Pan, Shirui Vu, Thuy-Trang Haffari, Gholamreza |
| author_facet | Wu, Tongtong Luo, Linhao Li, Yuan-Fang Pan, Shirui Vu, Thuy-Trang Haffari, Gholamreza |
| contents | Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving human knowledge. This paper surveys recent works on continual learning for LLMs. Due to the unique nature of LLMs, we catalog continue learning techniques in a novel multi-staged categorization scheme, involving continual pretraining, instruction tuning, and alignment. We contrast continual learning for LLMs with simpler adaptation methods used in smaller models, as well as with other enhancement strategies like retrieval-augmented generation and model editing. Moreover, informed by a discussion of benchmarks and evaluation, we identify several challenges and future work directions for this crucial task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_01364 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Continual Learning for Large Language Models: A Survey Wu, Tongtong Luo, Linhao Li, Yuan-Fang Pan, Shirui Vu, Thuy-Trang Haffari, Gholamreza Computation and Language Machine Learning Large language models (LLMs) are not amenable to frequent re-training, due to high training costs arising from their massive scale. However, updates are necessary to endow LLMs with new skills and keep them up-to-date with rapidly evolving human knowledge. This paper surveys recent works on continual learning for LLMs. Due to the unique nature of LLMs, we catalog continue learning techniques in a novel multi-staged categorization scheme, involving continual pretraining, instruction tuning, and alignment. We contrast continual learning for LLMs with simpler adaptation methods used in smaller models, as well as with other enhancement strategies like retrieval-augmented generation and model editing. Moreover, informed by a discussion of benchmarks and evaluation, we identify several challenges and future work directions for this crucial task. |
| title | Continual Learning for Large Language Models: A Survey |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2402.01364 |