Knowledge Boundary of Large Language Models: A Survey
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915305855385600 |
|---|---|
| author | Li, Moxin Zhao, Yong Zhang, Wenxuan Li, Shuaiyi Xie, Wenya Ng, See-Kiong Chua, Tat-Seng Deng, Yang |
| author_facet | Li, Moxin Zhao, Yong Zhang, Wenxuan Li, Shuaiyi Xie, Wenya Ng, See-Kiong Chua, Tat-Seng Deng, Yang |
| contents | Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, methods for identifying these boundaries, and strategies for mitigating the challenges they present. Finally, we discuss open challenges and potential research directions in this area. We aim for this survey to offer the community a comprehensive overview, facilitate access to key issues, and inspire further advancements in LLM knowledge research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_12472 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Knowledge Boundary of Large Language Models: A Survey Li, Moxin Zhao, Yong Zhang, Wenxuan Li, Shuaiyi Xie, Wenya Ng, See-Kiong Chua, Tat-Seng Deng, Yang Computation and Language Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, methods for identifying these boundaries, and strategies for mitigating the challenges they present. Finally, we discuss open challenges and potential research directions in this area. We aim for this survey to offer the community a comprehensive overview, facilitate access to key issues, and inspire further advancements in LLM knowledge research. |
| title | Knowledge Boundary of Large Language Models: A Survey |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2412.12472 |