Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918263950147584 |
|---|---|
| author | Hu, Zhengyu Lian, Jianxun Xiao, Zheyuan Zhang, Seraphina Wang, Tianfu Yuan, Nicholas Jing Xie, Xing Xiong, Hui |
| author_facet | Hu, Zhengyu Lian, Jianxun Xiao, Zheyuan Zhang, Seraphina Wang, Tianfu Yuan, Nicholas Jing Xie, Xing Xiong, Hui |
| contents | Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains underexplored. In this work, we address this gap by introducing a framework inspired by cognitive psychology and education. Specifically, we decompose general learning ability into three distinct, complementary dimensions: Learning from Instructor (acquiring knowledge via explicit guidance), Learning from Concept (internalizing abstract structures and generalizing to new contexts), and Learning from Experience (adapting through accumulated exploration and feedback). We conduct a comprehensive empirical study across the three learning dimensions and identify several insightful findings, such as (i) interaction improves learning; (ii) conceptual understanding is scale-emergent and benefits larger models; and (iii) LLMs are effective few-shot learners but not many-shot learners. Based on our framework and empirical findings, we introduce a benchmark that provides a unified and realistic evaluation of LLMs' general learning abilities across three learning cognition dimensions. It enables diagnostic insights and supports evaluation and development of more adaptive and human-like models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_13464 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study Hu, Zhengyu Lian, Jianxun Xiao, Zheyuan Zhang, Seraphina Wang, Tianfu Yuan, Nicholas Jing Xie, Xing Xiong, Hui Computation and Language Artificial Intelligence Large language models (LLMs) have shown impressive capabilities across tasks such as mathematics, coding, and reasoning, yet their learning ability, which is crucial for adapting to dynamic environments and acquiring new knowledge, remains underexplored. In this work, we address this gap by introducing a framework inspired by cognitive psychology and education. Specifically, we decompose general learning ability into three distinct, complementary dimensions: Learning from Instructor (acquiring knowledge via explicit guidance), Learning from Concept (internalizing abstract structures and generalizing to new contexts), and Learning from Experience (adapting through accumulated exploration and feedback). We conduct a comprehensive empirical study across the three learning dimensions and identify several insightful findings, such as (i) interaction improves learning; (ii) conceptual understanding is scale-emergent and benefits larger models; and (iii) LLMs are effective few-shot learners but not many-shot learners. Based on our framework and empirical findings, we introduce a benchmark that provides a unified and realistic evaluation of LLMs' general learning abilities across three learning cognition dimensions. It enables diagnostic insights and supports evaluation and development of more adaptive and human-like models. |
| title | Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Study |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2506.13464 |