Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911099997126656 |
|---|---|
| author | Wu, Tao Chen, Jingyuan Lin, Wang Li, Mengze Zhu, Yumeng Li, Ang Kuang, Kun Wu, Fei |
| author_facet | Wu, Tao Chen, Jingyuan Lin, Wang Li, Mengze Zhu, Yumeng Li, Ang Kuang, Kun Wu, Fei |
| contents | Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of students at various cognitive levels. However, current LLMs, typically trained as ``helpful assistants'', target at generating perfect responses. As a result, they struggle to simulate students with diverse cognitive abilities, as they often produce overly advanced answers, missing the natural imperfections that characterize student learning and resulting in unrealistic simulations. To address this issue, we propose a training-free framework for student simulation. We begin by constructing a cognitive prototype for each student using a knowledge graph, which captures their understanding of concepts from past learning records. This prototype is then mapped to new tasks to predict student performance. Next, we simulate student solutions based on these predictions and iteratively refine them using a beam search method to better replicate realistic mistakes. To validate our approach, we construct the \texttt{Student\_100} dataset, consisting of $100$ students working on Python programming and $5,000$ learning records. Experimental results show that our method consistently outperforms baseline models, achieving $100\%$ improvement in simulation accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_19997 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents Wu, Tao Chen, Jingyuan Lin, Wang Li, Mengze Zhu, Yumeng Li, Ang Kuang, Kun Wu, Fei Machine Learning Computation and Language Computers and Society Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of students at various cognitive levels. However, current LLMs, typically trained as ``helpful assistants'', target at generating perfect responses. As a result, they struggle to simulate students with diverse cognitive abilities, as they often produce overly advanced answers, missing the natural imperfections that characterize student learning and resulting in unrealistic simulations. To address this issue, we propose a training-free framework for student simulation. We begin by constructing a cognitive prototype for each student using a knowledge graph, which captures their understanding of concepts from past learning records. This prototype is then mapped to new tasks to predict student performance. Next, we simulate student solutions based on these predictions and iteratively refine them using a beam search method to better replicate realistic mistakes. To validate our approach, we construct the \texttt{Student\_100} dataset, consisting of $100$ students working on Python programming and $5,000$ learning records. Experimental results show that our method consistently outperforms baseline models, achieving $100\%$ improvement in simulation accuracy. |
| title | Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents |
| topic | Machine Learning Computation and Language Computers and Society |
| url | https://arxiv.org/abs/2505.19997 |