An Automated Explainable Educational Assessment System Built on LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915069406740480 |
|---|---|
| author | Li, Jiazheng Bobrov, Artem West, David Aloisi, Cesare He, Yulan |
| author_facet | Li, Jiazheng Bobrov, Artem West, David Aloisi, Cesare He, Yulan |
| contents | In this demo, we present AERA Chat, an automated and explainable educational assessment system designed for interactive and visual evaluations of student responses. This system leverages large language models (LLMs) to generate automated marking and rationale explanations, addressing the challenge of limited explainability in automated educational assessment and the high costs associated with annotation. Our system allows users to input questions and student answers, providing educators and researchers with insights into assessment accuracy and the quality of LLM-assessed rationales. Additionally, it offers advanced visualization and robust evaluation tools, enhancing the usability for educational assessment and facilitating efficient rationale verification. Our demo video can be found at https://youtu.be/qUSjz-sxlBc. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_13381 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An Automated Explainable Educational Assessment System Built on LLMs Li, Jiazheng Bobrov, Artem West, David Aloisi, Cesare He, Yulan Computation and Language In this demo, we present AERA Chat, an automated and explainable educational assessment system designed for interactive and visual evaluations of student responses. This system leverages large language models (LLMs) to generate automated marking and rationale explanations, addressing the challenge of limited explainability in automated educational assessment and the high costs associated with annotation. Our system allows users to input questions and student answers, providing educators and researchers with insights into assessment accuracy and the quality of LLM-assessed rationales. Additionally, it offers advanced visualization and robust evaluation tools, enhancing the usability for educational assessment and facilitating efficient rationale verification. Our demo video can be found at https://youtu.be/qUSjz-sxlBc. |
| title | An Automated Explainable Educational Assessment System Built on LLMs |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2412.13381 |