Cover Image

How Consistent Are Humans When Grading Programming Assignments?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Messer, Marcus, Brown, Neil C. C., Kölling, Michael, Shi, Miaojing
Format:	Preprint
Published:	2024
Subjects:	Computers and Society
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Howzat? Appealing to Expert Judgement for Evaluating Human and AI Next-Step Hints for Novice Programmers
by: Brown, Neil C. C., et al.
Published: (2024)

Optimizing Peer Grading: A Systematic Literature Review of Reviewer Assignment Strategies and Quantity of Reviewers
by: Paul, Uchswas, et al.
Published: (2025)

A Zero-Shot LLM Framework for Automatic Assignment Grading in Higher Education
by: Yeung, Calvin, et al.
Published: (2025)

Influence of Personality Traits on Plagiarism Through Collusion in Programming Assignments
by: PD, Parthasarathy, et al.
Published: (2024)

Reducing Procrastination on Programming Assignments via Optional Early Feedback
by: Gao, Alice, et al.
Published: (2025)

Automated Assignment Grading with Large Language Models: Insights From a Bioinformatics Course
by: Poličar, Pavlin G., et al.
Published: (2025)

SimGrade: Using Code Similarity Measures for More Accurate Human Grading
by: Johnson-Yu, Sonja, et al.
Published: (2024)

The Personality Trap: How LLMs Embed Bias When Generating Human-Like Personas
by: Amidei, Jacopo, et al.
Published: (2026)

Interpreting Latent Student Knowledge Representations in Programming Assignments
by: Fernandez, Nigel, et al.
Published: (2024)

Thoughts on Learning Human and Programming Languages
by: Katz, Daniel S., et al.
Published: (2024)

FastFixer: An Efficient and Effective Approach for Repairing Programming Assignments
by: Liu, Fang, et al.
Published: (2024)

A Task-Driven Human-AI Collaboration: When to Automate, When to Collaborate, When to Challenge
by: Afroogh, Saleh, et al.
Published: (2025)

$μ$Ed API: Towards a Shared API for Education Microservices
by: Sölch, Maximillan, et al.
Published: (2026)

Economics of Human and AI Collaboration: When is Partial Automation More Attractive than Full Automation?
by: Li, Wensu, et al.
Published: (2026)

LeafTutor: An AI Agent for Programming Assignment Tutoring
by: Bochard, Madison, et al.
Published: (2025)

When Machines Get It Wrong: Large Language Models Perpetuate Autism Myths More Than Humans Do
by: Garrido-Merchán, Eduardo C., et al.
Published: (2026)

Impeding LLM-assisted Cheating in Introductory Programming Assignments via Adversarial Perturbation
by: Salim, Saiful Islam, et al.
Published: (2024)

Human-in-the-Loop LLM Grading for Handwritten Mathematics Assessments
by: Vanhoyweghen, Arne, et al.
Published: (2026)

When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review
by: Fontana, Maxime, et al.
Published: (2023)

Too Human to Model:The Uncanny Valley of LLMs in Social Simulation -- When Generative Language Agents Misalign with Modelling Principles
by: Zeng, Yongchao, et al.
Published: (2025)

Out of the Loop Again: How Dangerous is Weaponizing Automated Nuclear Systems?
by: Schwartz, Joshua A., et al.
Published: (2025)

InvAASTCluster: On Applying Invariant-Based Program Clustering to Introductory Programming Assignments
by: Orvalho, Pedro, et al.
Published: (2022)

Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments
by: Kannam, Suhas, et al.
Published: (2024)

CodEv: An Automated Grading Framework Leveraging Large Language Models for Consistent and Constructive Feedback
by: Tseng, En-Qi, et al.
Published: (2025)

Morally Programmed LLMs Reshape Human Morality
by: Lyu, Pengzhao, et al.
Published: (2026)

Logic Error Localization in Student Programming Assignments Using Pseudocode and Graph Neural Networks
by: Xu, Zhenyu, et al.
Published: (2024)

Humanizing Automated Programming Feedback: Fine-Tuning Generative Models with Student-Written Feedback
by: Pădurean, Victor-Alexandru, et al.
Published: (2025)

LLM Chatbots in High School Programming: Exploring Behaviors and Interventions
by: Torre, Manuel Valle, et al.
Published: (2025)

Patterns of Student Help-Seeking When Using a Large Language Model-Powered Programming Assistant
by: Sheese, Brad, et al.
Published: (2023)

When does AI support thinking, and when does it replace it? Learners' conceptualisations of AI as a dynamic cognitive partner: A typology
by: Chan, C. K. Y
Published: (2026)

What is Human in Judgment? Comparing Automation Bias and Algorithm Aversion Between the United States Military Academy and the General Public
by: Kahn, Lauren, et al.
Published: (2026)

Comparison of Three Programming Error Measures for Explaining Variability in CS1 Grades
by: Švábenský, Valdemar, et al.
Published: (2024)

Desirable Characteristics for AI Teaching Assistants in Programming Education
by: Denny, Paul, et al.
Published: (2024)

Evaluating Chinese Large Language Models: The Influence of Persona Assignment on Stereotypes and Safeguards
by: Liu, Geng, et al.
Published: (2025)

A Grading Rubric for AI Safety Frameworks
by: Alaga, Jide, et al.
Published: (2024)

Solving Jigsaw Puzzles using Iterative Random Sampling: Parallels with Development of Skill Mastery
by: Zhao, Neil, et al.
Published: (2024)

Probing the Unknown: Exploring Student Interactions with Probeable Problems at Scale in Introductory Programming
by: Denny, Paul, et al.
Published: (2025)

Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethics
by: Grande, Virginia, et al.
Published: (2024)

Candidate Incentive Distributions: How voting methods shape electoral incentives
by: Ogren, Marcus
Published: (2023)

KOALA: a Configurable Tool for Collecting IDE Data When Solving Programming Tasks
by: Karol, Daniil, et al.
Published: (2025)