Has Automated Essay Scoring Reached Sufficient Accuracy? Deriving Achievable QWK Ceilings from Classical Test Theory
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | Uto, Masaki |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Has LLM Reached the Scaling Ceiling Yet? Unified Insights into LLM Regularities and Constraints
par: Luo, Charles
Publié: (2024)
par: Luo, Charles
Publié: (2024)
Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems
par: Ormerod, Christopher
Publié: (2025)
par: Ormerod, Christopher
Publié: (2025)
Rank-Then-Score: Enhancing Large Language Models for Automated Essay Scoring
par: Cai, Yida, et autres
Publié: (2025)
par: Cai, Yida, et autres
Publié: (2025)
Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring
par: Kubesch, Jonas, et autres
Publié: (2026)
par: Kubesch, Jonas, et autres
Publié: (2026)
AI-generated Essays: Characteristics and Implications on Automated Scoring and Academic Integrity
par: Zhong, Yang, et autres
Publié: (2024)
par: Zhong, Yang, et autres
Publié: (2024)
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models
par: Su, Jiamin, et autres
Publié: (2025)
par: Su, Jiamin, et autres
Publié: (2025)
Towards Prompt Generalization: Grammar-aware Cross-Prompt Automated Essay Scoring
par: Do, Heejin, et autres
Publié: (2025)
par: Do, Heejin, et autres
Publié: (2025)
Autoregressive Score Generation for Multi-trait Essay Scoring
par: Do, Heejin, et autres
Publié: (2024)
par: Do, Heejin, et autres
Publié: (2024)
Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs
par: Chu, SeongYeub, et autres
Publié: (2024)
par: Chu, SeongYeub, et autres
Publié: (2024)
Leveraging AI Graders for Missing Score Imputation to Achieve Accurate Ability Estimation in Constructed-Response Tests
par: Uto, Masaki, et autres
Publié: (2025)
par: Uto, Masaki, et autres
Publié: (2025)
LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models
par: Shibata, Takumi, et autres
Publié: (2025)
par: Shibata, Takumi, et autres
Publié: (2025)
The Impact of LLM Self-Consistency and Reasoning Effort on Automated Scoring Accuracy and Cost
par: Frohn, Scott
Publié: (2026)
par: Frohn, Scott
Publié: (2026)
Teach-to-Reason with Scoring: Self-Explainable Rationale-Driven Multi-Trait Essay Scoring
par: Do, Heejin, et autres
Publié: (2025)
par: Do, Heejin, et autres
Publié: (2025)
DREsS: Dataset for Rubric-based Essay Scoring on EFL Writing
par: Yoo, Haneul, et autres
Publié: (2024)
par: Yoo, Haneul, et autres
Publié: (2024)
Activations as Features: Probing LLMs for Generalizable Essay Scoring Representations
par: Chi, Jinwei, et autres
Publié: (2025)
par: Chi, Jinwei, et autres
Publié: (2025)
Improve LLM-based Automatic Essay Scoring with Linguistic Features
par: Hou, Zhaoyi Joey, et autres
Publié: (2025)
par: Hou, Zhaoyi Joey, et autres
Publié: (2025)
Automatic Essay Scoring and Feedback Generation in Basque Language Learning
par: Azurmendi, Ekhi, et autres
Publié: (2025)
par: Azurmendi, Ekhi, et autres
Publié: (2025)
Assessing GPTZero's Accuracy in Identifying AI vs. Human-Written Essays
par: Dik, Selin, et autres
Publié: (2025)
par: Dik, Selin, et autres
Publié: (2025)
Autoregressive Multi-trait Essay Scoring via Reinforcement Learning with Scoring-aware Multiple Rewards
par: Do, Heejin, et autres
Publié: (2024)
par: Do, Heejin, et autres
Publié: (2024)
Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
par: Hallaç, İbrahim Rıza, et autres
Publié: (2026)
par: Hallaç, İbrahim Rıza, et autres
Publié: (2026)
Automatic Essay Multi-dimensional Scoring with Fine-tuning and Multiple Regression
par: Sun, Kun, et autres
Publié: (2024)
par: Sun, Kun, et autres
Publié: (2024)
Can Large Language Models Automatically Score Proficiency of Written Essays?
par: Mansour, Watheq, et autres
Publié: (2024)
par: Mansour, Watheq, et autres
Publié: (2024)
LLM Essay Scoring Under Holistic and Analytic Rubrics: Prompt Effects and Bias
par: Kucia, Filip J., et autres
Publié: (2026)
par: Kucia, Filip J., et autres
Publié: (2026)
Decision-Level Ordinal Modeling for Multimodal Essay Scoring with Large Language Models
par: Zhang, Han, et autres
Publié: (2026)
par: Zhang, Han, et autres
Publié: (2026)
Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs
par: Xiao, Changrong, et autres
Publié: (2024)
par: Xiao, Changrong, et autres
Publié: (2024)
Enhancing Essay Scoring with Adversarial Weights Perturbation and Metric-specific AttentionPooling
par: Huang, Jiaxin, et autres
Publié: (2024)
par: Huang, Jiaxin, et autres
Publié: (2024)
Explaining and Breaking the Safety-Helpfulness Ceiling via Preference Dimensional Expansion
par: Huang, ShiYing, et autres
Publié: (2026)
par: Huang, ShiYing, et autres
Publié: (2026)
Capability Ceilings in Autoregressive Language Models: Empirical Evidence from Knowledge-Intensive Tasks
par: Marín, Javier
Publié: (2025)
par: Marín, Javier
Publié: (2025)
Diagnosing Spectral Ceilings in Equivariant Neural Force Fields
par: Kim, Hyunmog
Publié: (2026)
par: Kim, Hyunmog
Publié: (2026)
CAFES: A Collaborative Multi-Agent Framework for Multi-Granular Multimodal Essay Scoring
par: Su, Jiamin, et autres
Publié: (2025)
par: Su, Jiamin, et autres
Publié: (2025)
Transformer-based Joint Modelling for Automatic Essay Scoring and Off-Topic Detection
par: Das, Sourya Dipta, et autres
Publié: (2024)
par: Das, Sourya Dipta, et autres
Publié: (2024)
Using ChatGPT to Score Essays and Short-Form Constructed Responses
par: Shermis, Mark D.
Publié: (2024)
par: Shermis, Mark D.
Publié: (2024)
Securing the Floor and Raising the Ceiling: A Merging-based Paradigm for Multi-modal Search Agents
par: Wang, Zhixiang, et autres
Publié: (2026)
par: Wang, Zhixiang, et autres
Publié: (2026)
Logic-Free Building Automation: Learning the Control of Room Facilities with Wall Switches and Ceiling Camera
par: Ochiai, Hideya, et autres
Publié: (2024)
par: Ochiai, Hideya, et autres
Publié: (2024)
Enhancing Essay Cohesion Assessment: A Novel Item Response Theory Approach
par: Rosa, Bruno Alexandre, et autres
Publié: (2025)
par: Rosa, Bruno Alexandre, et autres
Publié: (2025)
Diffusion Denoiser Achievable Analysis for Finite Blocklength Unsourced Random Access
par: Han, Yuming, et autres
Publié: (2026)
par: Han, Yuming, et autres
Publié: (2026)
An Essay concerning machine understanding
par: Roitblat, Herbert L.
Publié: (2024)
par: Roitblat, Herbert L.
Publié: (2024)
Assessing the Reliability and Validity of Large Language Models for Automated Assessment of Student Essays in Higher Education
par: Gaggioli, Andrea, et autres
Publié: (2025)
par: Gaggioli, Andrea, et autres
Publié: (2025)
Ensembling Tabular Foundation Models - A Diversity Ceiling And A Calibration Trap
par: Tanna, Aditya, et autres
Publié: (2026)
par: Tanna, Aditya, et autres
Publié: (2026)
Diffusion-Inspired Cold Start with Sufficient Prior in Computerized Adaptive Testing
par: Ma, Haiping, et autres
Publié: (2024)
par: Ma, Haiping, et autres
Publié: (2024)
Documents similaires
-
Has LLM Reached the Scaling Ceiling Yet? Unified Insights into LLM Regularities and Constraints
par: Luo, Charles
Publié: (2024) -
Automated Essay Scoring Incorporating Annotations from Automated Feedback Systems
par: Ormerod, Christopher
Publié: (2025) -
Rank-Then-Score: Enhancing Large Language Models for Automated Essay Scoring
par: Cai, Yida, et autres
Publié: (2025) -
Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring
par: Kubesch, Jonas, et autres
Publié: (2026) -
AI-generated Essays: Characteristics and Implications on Automated Scoring and Academic Integrity
par: Zhong, Yang, et autres
Publié: (2024)