Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.06465 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908308459225088 |
|---|---|
| author | Ye Ma |
| author_facet | Ye Ma |
| contents | This study explores using Natural Language Processing (NLP) to analyze candidate comments for identifying problematic test items. We developed and validated machine learning models that automatically identify relevant negative feedback, evaluated approaches of incorporating psychometric features enhances model performance, and compared NLP-flagged items with traditionally flagged items. Results demonstrate that candidate feedback provides valuable complementary information to statistical methods, potentially improving test validity while reducing manual review burden. This research offers testing organizations an efficient mechanism to incorporate direct candidate experience into quality assurance processes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_06465 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Analyzing Examinee Comments using DistilBERT and Machine Learning to Ensure Quality Control in Exam Content Ye Ma Computation and Language This study explores using Natural Language Processing (NLP) to analyze candidate comments for identifying problematic test items. We developed and validated machine learning models that automatically identify relevant negative feedback, evaluated approaches of incorporating psychometric features enhances model performance, and compared NLP-flagged items with traditionally flagged items. Results demonstrate that candidate feedback provides valuable complementary information to statistical methods, potentially improving test validity while reducing manual review burden. This research offers testing organizations an efficient mechanism to incorporate direct candidate experience into quality assurance processes. |
| title | Analyzing Examinee Comments using DistilBERT and Machine Learning to Ensure Quality Control in Exam Content |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2504.06465 |