From Coders to Critics: Empowering Students through Peer Assessment in the Age of AI Copilots

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Berrezueta-Guzman, Santiago, Krusche, Stephan, Wagner, Stefan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915309707853824
author Berrezueta-Guzman, Santiago
Krusche, Stephan
Wagner, Stefan
author_facet Berrezueta-Guzman, Santiago
Krusche, Stephan
Wagner, Stefan
contents The rapid adoption of AI powered coding assistants like ChatGPT and other coding copilots is transforming programming education, raising questions about assessment practices, academic integrity, and skill development. As educators seek alternatives to traditional grading methods susceptible to AI enabled plagiarism, structured peer assessment could be a promising strategy. This paper presents an empirical study of a rubric based, anonymized peer review process implemented in a large introductory programming course. Students evaluated each other's final projects (2D game), and their assessments were compared to instructor grades using correlation, mean absolute error, and root mean square error (RMSE). Additionally, reflective surveys from 47 teams captured student perceptions of fairness, grading behavior, and preferences regarding grade aggregation. Results show that peer review can approximate instructor evaluation with moderate accuracy and foster student engagement, evaluative thinking, and interest in providing good feedback to their peers. We discuss these findings for designing scalable, trustworthy peer assessment systems to face the age of AI assisted coding.
format Preprint
id arxiv_https___arxiv_org_abs_2505_22093
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Coders to Critics: Empowering Students through Peer Assessment in the Age of AI Copilots
Berrezueta-Guzman, Santiago
Krusche, Stephan
Wagner, Stefan
Computers and Society
Artificial Intelligence
Human-Computer Interaction
The rapid adoption of AI powered coding assistants like ChatGPT and other coding copilots is transforming programming education, raising questions about assessment practices, academic integrity, and skill development. As educators seek alternatives to traditional grading methods susceptible to AI enabled plagiarism, structured peer assessment could be a promising strategy. This paper presents an empirical study of a rubric based, anonymized peer review process implemented in a large introductory programming course. Students evaluated each other's final projects (2D game), and their assessments were compared to instructor grades using correlation, mean absolute error, and root mean square error (RMSE). Additionally, reflective surveys from 47 teams captured student perceptions of fairness, grading behavior, and preferences regarding grade aggregation. Results show that peer review can approximate instructor evaluation with moderate accuracy and foster student engagement, evaluative thinking, and interest in providing good feedback to their peers. We discuss these findings for designing scalable, trustworthy peer assessment systems to face the age of AI assisted coding.
title From Coders to Critics: Empowering Students through Peer Assessment in the Age of AI Copilots
topic Computers and Society
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2505.22093