A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yeung, Calvin, Yu, Jeff, Cheung, King Chau, Wong, Tat Wing, Chan, Chun Man, Wong, Kin Chi, Fujii, Keisuke
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910797759774720
author Yeung, Calvin
Yu, Jeff
Cheung, King Chau
Wong, Tat Wing
Chan, Chun Man
Wong, Kin Chi
Fujii, Keisuke
author_facet Yeung, Calvin
Yu, Jeff
Cheung, King Chau
Wong, Tat Wing
Chan, Chun Man
Wong, Kin Chi
Fujii, Keisuke
contents Automated grading has become an essential tool in education technology due to its ability to efficiently assess large volumes of student work, provide consistent and unbiased evaluations, and deliver immediate feedback to enhance learning. However, current systems face significant limitations, including the need for large datasets in few-shot learning methods, a lack of personalized and actionable feedback, and an overemphasis on benchmark performance rather than student experience. To address these challenges, we propose a Zero-Shot Large Language Model (LLM)-Based Automated Assignment Grading (AAG) system. This framework leverages prompt engineering to evaluate both computational and explanatory student responses without requiring additional training or fine-tuning. The AAG system delivers tailored feedback that highlights individual strengths and areas for improvement, thereby enhancing student learning outcomes. Our study demonstrates the system's effectiveness through comprehensive evaluations, including survey responses from higher education students that indicate significant improvements in motivation, understanding, and preparedness compared to traditional grading methods. The results validate the AAG system's potential to transform educational assessment by prioritizing learning experiences and providing scalable, high-quality feedback.
format Preprint
id arxiv_https___arxiv_org_abs_2501_14305
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education
Yeung, Calvin
Yu, Jeff
Cheung, King Chau
Wong, Tat Wing
Chan, Chun Man
Wong, Kin Chi
Fujii, Keisuke
Computers and Society
Artificial Intelligence
Automated grading has become an essential tool in education technology due to its ability to efficiently assess large volumes of student work, provide consistent and unbiased evaluations, and deliver immediate feedback to enhance learning. However, current systems face significant limitations, including the need for large datasets in few-shot learning methods, a lack of personalized and actionable feedback, and an overemphasis on benchmark performance rather than student experience. To address these challenges, we propose a Zero-Shot Large Language Model (LLM)-Based Automated Assignment Grading (AAG) system. This framework leverages prompt engineering to evaluate both computational and explanatory student responses without requiring additional training or fine-tuning. The AAG system delivers tailored feedback that highlights individual strengths and areas for improvement, thereby enhancing student learning outcomes. Our study demonstrates the system's effectiveness through comprehensive evaluations, including survey responses from higher education students that indicate significant improvements in motivation, understanding, and preparedness compared to traditional grading methods. The results validate the AAG system's potential to transform educational assessment by prioritizing learning experiences and providing scalable, high-quality feedback.
title A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2501.14305