Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wei, Yuang, Wang, Fei, Zhang, Yifan, Lim, Brian Y., Jiang, Bo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914374899204096
author Wei, Yuang
Wang, Fei
Zhang, Yifan
Lim, Brian Y.
Jiang, Bo
author_facet Wei, Yuang
Wang, Fei
Zhang, Yifan
Lim, Brian Y.
Jiang, Bo
contents Assessment literacy (AL) is essential for personalized education, yet difficult to cultivate in pre-service teachers. Conventional teacher preparation programs focus on theoretical knowledge, while digital assessment tools commonly provide opaque scores or parameters. These limitations hinder reflection and transfer, leaving AL underdeveloped. We propose XIA, an eXplainable Intelligent Assessment platform that extends statistics-informed support with visualized cognitive diagnostic reasoning, including contrastive and counterfactual explanations. In a pre-post controlled study with 21 pre-service teachers, we combined quantitative tasks and questionnaires with qualitative interviews. The findings offer preliminary evidence that XIA supported reflection, self-regulation, and assessment awareness, and helped reduce assessment errors. Interviews further showed a shift from score-based judgments toward evidence-based reasoning. This work contributes insights into the design of intelligent assessment tools, showing how explanatory scaffolding can bridge assessment theory and classroom practice and support the cultivation of AL in teacher education.
format Preprint
id arxiv_https___arxiv_org_abs_2603_06059
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy
Wei, Yuang
Wang, Fei
Zhang, Yifan
Lim, Brian Y.
Jiang, Bo
Human-Computer Interaction
Assessment literacy (AL) is essential for personalized education, yet difficult to cultivate in pre-service teachers. Conventional teacher preparation programs focus on theoretical knowledge, while digital assessment tools commonly provide opaque scores or parameters. These limitations hinder reflection and transfer, leaving AL underdeveloped. We propose XIA, an eXplainable Intelligent Assessment platform that extends statistics-informed support with visualized cognitive diagnostic reasoning, including contrastive and counterfactual explanations. In a pre-post controlled study with 21 pre-service teachers, we combined quantitative tasks and questionnaires with qualitative interviews. The findings offer preliminary evidence that XIA supported reflection, self-regulation, and assessment awareness, and helped reduce assessment errors. Interviews further showed a shift from score-based judgments toward evidence-based reasoning. This work contributes insights into the design of intelligent assessment tools, showing how explanatory scaffolding can bridge assessment theory and classroom practice and support the cultivation of AL in teacher education.
title Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers' Assessment Literacy
topic Human-Computer Interaction
url https://arxiv.org/abs/2603.06059