Saved in:
Bibliographic Details
Main Authors: Wang, Chihang, Dong, Yuxin, Zhang, Zhenhong, Wang, Ruotong, Wang, Shuo, Chen, Jiajing
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.14165
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916444672884736
author Wang, Chihang
Dong, Yuxin
Zhang, Zhenhong
Wang, Ruotong
Wang, Shuo
Chen, Jiajing
author_facet Wang, Chihang
Dong, Yuxin
Zhang, Zhenhong
Wang, Ruotong
Wang, Shuo
Chen, Jiajing
contents This paper focuses on the development of an advanced intelligent article scoring system that not only assesses the overall quality of written work but also offers detailed feature-based scoring tailored to various article genres. By integrating the pre-trained BERT model with the large language model Chat-GPT, the system gains a deep understanding of both the content and structure of the text, enabling it to provide a thorough evaluation along with targeted suggestions for improvement. Experimental results demonstrate that this system outperforms traditional scoring methods across multiple public datasets, particularly in feature-based assessments, offering a more accurate reflection of the quality of different article types. Moreover, the system generates personalized feedback to assist users in enhancing their writing skills, underscoring the potential and practical value of automated scoring technologies in educational contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2410_14165
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automated Genre-Aware Article Scoring and Feedback Using Large Language Models
Wang, Chihang
Dong, Yuxin
Zhang, Zhenhong
Wang, Ruotong
Wang, Shuo
Chen, Jiajing
Computation and Language
This paper focuses on the development of an advanced intelligent article scoring system that not only assesses the overall quality of written work but also offers detailed feature-based scoring tailored to various article genres. By integrating the pre-trained BERT model with the large language model Chat-GPT, the system gains a deep understanding of both the content and structure of the text, enabling it to provide a thorough evaluation along with targeted suggestions for improvement. Experimental results demonstrate that this system outperforms traditional scoring methods across multiple public datasets, particularly in feature-based assessments, offering a more accurate reflection of the quality of different article types. Moreover, the system generates personalized feedback to assist users in enhancing their writing skills, underscoring the potential and practical value of automated scoring technologies in educational contexts.
title Automated Genre-Aware Article Scoring and Feedback Using Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2410.14165