Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kannam, Suhas, Yang, Yuri, Dharm, Aarya, Lin, Kevin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912122171031552
author Kannam, Suhas
Yang, Yuri
Dharm, Aarya
Lin, Kevin
author_facet Kannam, Suhas
Yang, Yuri
Dharm, Aarya
Lin, Kevin
contents Generative artificial intelligence poses new challenges around assessment, increasingly driving introductory programming educators to employ invigilated exams. But exams do not afford more authentic programming experiences that involve planning, implementing, and debugging programs with computer interaction. In this experience report, we describe code interviews: a more authentic assessment method for take-home programming assignments. Through action research, we experimented with varying the number and type of questions as well as whether interviews were conducted individually or with groups of students. To scale the program, we converted most of our weekly teaching assistant (TA) sections to conduct code interviews on 5 major weekly take-home programming assignments. By triangulating data from 5 sources, we identified 4 themes. Code interviews (1) pushed students to discuss their work, motivating more nuanced but sometimes repetitive insights; (2) enabled peer learning, reducing stress in some ways but increasing stress in other ways; (3) scaled with TA-led sections, replacing familiar practice with an unfamiliar assessment; (4) focused on student contributions, limiting opportunities for TAs to give guidance and feedback. We conclude by discussing the different decisions about the design of code interviews with implications for student experience, academic integrity, and teaching workload.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01010
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments
Kannam, Suhas
Yang, Yuri
Dharm, Aarya
Lin, Kevin
Computers and Society
K.3.2
Generative artificial intelligence poses new challenges around assessment, increasingly driving introductory programming educators to employ invigilated exams. But exams do not afford more authentic programming experiences that involve planning, implementing, and debugging programs with computer interaction. In this experience report, we describe code interviews: a more authentic assessment method for take-home programming assignments. Through action research, we experimented with varying the number and type of questions as well as whether interviews were conducted individually or with groups of students. To scale the program, we converted most of our weekly teaching assistant (TA) sections to conduct code interviews on 5 major weekly take-home programming assignments. By triangulating data from 5 sources, we identified 4 themes. Code interviews (1) pushed students to discuss their work, motivating more nuanced but sometimes repetitive insights; (2) enabled peer learning, reducing stress in some ways but increasing stress in other ways; (3) scaled with TA-led sections, replacing familiar practice with an unfamiliar assessment; (4) focused on student contributions, limiting opportunities for TAs to give guidance and feedback. We conclude by discussing the different decisions about the design of code interviews with implications for student experience, academic integrity, and teaching workload.
title Code Interviews: Design and Evaluation of a More Authentic Assessment for Introductory Programming Assignments
topic Computers and Society
K.3.2
url https://arxiv.org/abs/2410.01010