Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909676277334016 |
|---|---|
| author | Moon, Hyeongdon Davis, Richard Neshaei, Seyed Parsa Dillenbourg, Pierre |
| author_facet | Moon, Hyeongdon Davis, Richard Neshaei, Seyed Parsa Dillenbourg, Pierre |
| contents | Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students. However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical data and instructor-defined knowledge components, making it challenging to integrate AI-generated educational content with traditional established methods. We propose a method for automatically extracting knowledge components from educational content using instruction-tuned large multimodal models. We validate this approach by comprehensively evaluating it against knowledge tracing benchmarks in five domains. Our results indicate that the automatically extracted knowledge components can effectively replace human-tagged labels, offering a promising direction for enhancing intelligent tutoring systems in limited-data scenarios, achieving more explainable assessments in educational settings, and laying the groundwork for automated assessment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_20167 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information Moon, Hyeongdon Davis, Richard Neshaei, Seyed Parsa Dillenbourg, Pierre Computation and Language Knowledge tracing models have enabled a range of intelligent tutoring systems to provide feedback to students. However, existing methods for knowledge tracing in learning sciences are predominantly reliant on statistical data and instructor-defined knowledge components, making it challenging to integrate AI-generated educational content with traditional established methods. We propose a method for automatically extracting knowledge components from educational content using instruction-tuned large multimodal models. We validate this approach by comprehensively evaluating it against knowledge tracing benchmarks in five domains. Our results indicate that the automatically extracted knowledge components can effectively replace human-tagged labels, offering a promising direction for enhancing intelligent tutoring systems in limited-data scenarios, achieving more explainable assessments in educational settings, and laying the groundwork for automated assessment. |
| title | Using Large Multimodal Models to Extract Knowledge Components for Knowledge Tracing from Multimedia Question Information |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2409.20167 |