Content Knowledge Identification with Multi-Agent Large Language Models (LLMs)
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913492289716224 |
|---|---|
| author | Yang, Kaiqi Chu, Yucheng Darwin, Taylor Han, Ahreum Li, Hang Wen, Hongzhi Copur-Gencturk, Yasemin Tang, Jiliang Liu, Hui |
| author_facet | Yang, Kaiqi Chu, Yucheng Darwin, Taylor Han, Ahreum Li, Hang Wen, Hongzhi Copur-Gencturk, Yasemin Tang, Jiliang Liu, Hui |
| contents | Teachers' mathematical content knowledge (CK) is of vital importance and need in teacher professional development (PD) programs. Computer-aided asynchronous PD systems are the most recent proposed PD techniques, which aim to help teachers improve their PD equally with fewer concerns about costs and limitations of time or location. However, current automatic CK identification methods, which serve as one of the core techniques of asynchronous PD systems, face challenges such as diversity of user responses, scarcity of high-quality annotated data, and low interpretability of the predictions. To tackle these challenges, we propose a Multi-Agent LLMs-based framework, LLMAgent-CK, to assess the user responses' coverage of identified CK learning goals without human annotations. By taking advantage of multi-agent LLMs in strong generalization ability and human-like discussions, our proposed LLMAgent-CK presents promising CK identifying performance on a real-world mathematical CK dataset MaCKT. Moreover, our case studies further demonstrate the working of the multi-agent framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_07960 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Content Knowledge Identification with Multi-Agent Large Language Models (LLMs) Yang, Kaiqi Chu, Yucheng Darwin, Taylor Han, Ahreum Li, Hang Wen, Hongzhi Copur-Gencturk, Yasemin Tang, Jiliang Liu, Hui Artificial Intelligence Computers and Society Teachers' mathematical content knowledge (CK) is of vital importance and need in teacher professional development (PD) programs. Computer-aided asynchronous PD systems are the most recent proposed PD techniques, which aim to help teachers improve their PD equally with fewer concerns about costs and limitations of time or location. However, current automatic CK identification methods, which serve as one of the core techniques of asynchronous PD systems, face challenges such as diversity of user responses, scarcity of high-quality annotated data, and low interpretability of the predictions. To tackle these challenges, we propose a Multi-Agent LLMs-based framework, LLMAgent-CK, to assess the user responses' coverage of identified CK learning goals without human annotations. By taking advantage of multi-agent LLMs in strong generalization ability and human-like discussions, our proposed LLMAgent-CK presents promising CK identifying performance on a real-world mathematical CK dataset MaCKT. Moreover, our case studies further demonstrate the working of the multi-agent framework. |
| title | Content Knowledge Identification with Multi-Agent Large Language Models (LLMs) |
| topic | Artificial Intelligence Computers and Society |
| url | https://arxiv.org/abs/2404.07960 |