Modelling Assessment Rubrics through Bayesian Networks: a Pragmatic Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917738824335360 |
|---|---|
| author | Mangili, Francesca Adorni, Giorgia Piatti, Alberto Bonesana, Claudio Antonucci, Alessandro |
| author_facet | Mangili, Francesca Adorni, Giorgia Piatti, Alberto Bonesana, Claudio Antonucci, Alessandro |
| contents | Automatic assessment of learner competencies is a fundamental task in intelligent tutoring systems. An assessment rubric typically and effectively describes relevant competencies and competence levels. This paper presents an approach to deriving a learner model directly from an assessment rubric defining some (partial) ordering of competence levels. The model is based on Bayesian networks and exploits logical gates with uncertainty (often referred to as noisy gates) to reduce the number of parameters of the model, so to simplify their elicitation by experts and allow real-time inference in intelligent tutoring systems. We illustrate how the approach can be applied to automatize the human assessment of an activity developed for testing computational thinking skills. The simple elicitation of the model starting from the assessment rubric opens up the possibility of quickly automating the assessment of several tasks, making them more easily exploitable in the context of adaptive assessment tools and intelligent tutoring systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2209_05467 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Modelling Assessment Rubrics through Bayesian Networks: a Pragmatic Approach Mangili, Francesca Adorni, Giorgia Piatti, Alberto Bonesana, Claudio Antonucci, Alessandro Computers and Society Artificial Intelligence Automatic assessment of learner competencies is a fundamental task in intelligent tutoring systems. An assessment rubric typically and effectively describes relevant competencies and competence levels. This paper presents an approach to deriving a learner model directly from an assessment rubric defining some (partial) ordering of competence levels. The model is based on Bayesian networks and exploits logical gates with uncertainty (often referred to as noisy gates) to reduce the number of parameters of the model, so to simplify their elicitation by experts and allow real-time inference in intelligent tutoring systems. We illustrate how the approach can be applied to automatize the human assessment of an activity developed for testing computational thinking skills. The simple elicitation of the model starting from the assessment rubric opens up the possibility of quickly automating the assessment of several tasks, making them more easily exploitable in the context of adaptive assessment tools and intelligent tutoring systems. |
| title | Modelling Assessment Rubrics through Bayesian Networks: a Pragmatic Approach |
| topic | Computers and Society Artificial Intelligence |
| url | https://arxiv.org/abs/2209.05467 |