Improving Academic Skills Assessment with NLP and Ensemble Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Huang, Xinyi, Wu, Yingyi, Zhang, Danyang, Hu, Jiacheng, Long, Yujian
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910648108056576
author Huang, Xinyi
Wu, Yingyi
Zhang, Danyang
Hu, Jiacheng
Long, Yujian
author_facet Huang, Xinyi
Wu, Yingyi
Zhang, Danyang
Hu, Jiacheng
Long, Yujian
contents This study addresses the critical challenges of assessing foundational academic skills by leveraging advancements in natural language processing (NLP). Traditional assessment methods often struggle to provide timely and comprehensive feedback on key cognitive and linguistic aspects, such as coherence, syntax, and analytical reasoning. Our approach integrates multiple state-of-the-art NLP models, including BERT, RoBERTa, BART, DeBERTa, and T5, within an ensemble learning framework. These models are combined through stacking techniques using LightGBM and Ridge regression to enhance predictive accuracy. The methodology involves detailed data preprocessing, feature extraction, and pseudo-label learning to optimize model performance. By incorporating sophisticated NLP techniques and ensemble learning, this study significantly improves the accuracy and efficiency of assessments, offering a robust solution that surpasses traditional methods and opens new avenues for educational technology research focused on enhancing core academic competencies.
format Preprint
id arxiv_https___arxiv_org_abs_2409_19013
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving Academic Skills Assessment with NLP and Ensemble Learning
Huang, Xinyi
Wu, Yingyi
Zhang, Danyang
Hu, Jiacheng
Long, Yujian
Computation and Language
Artificial Intelligence
Computers and Society
Machine Learning
This study addresses the critical challenges of assessing foundational academic skills by leveraging advancements in natural language processing (NLP). Traditional assessment methods often struggle to provide timely and comprehensive feedback on key cognitive and linguistic aspects, such as coherence, syntax, and analytical reasoning. Our approach integrates multiple state-of-the-art NLP models, including BERT, RoBERTa, BART, DeBERTa, and T5, within an ensemble learning framework. These models are combined through stacking techniques using LightGBM and Ridge regression to enhance predictive accuracy. The methodology involves detailed data preprocessing, feature extraction, and pseudo-label learning to optimize model performance. By incorporating sophisticated NLP techniques and ensemble learning, this study significantly improves the accuracy and efficiency of assessments, offering a robust solution that surpasses traditional methods and opens new avenues for educational technology research focused on enhancing core academic competencies.
title Improving Academic Skills Assessment with NLP and Ensemble Learning
topic Computation and Language
Artificial Intelligence
Computers and Society
Machine Learning
url https://arxiv.org/abs/2409.19013