SPARK: Real-Time Monitoring of Multi-Faceted Programming Exercises

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Yinuo, Zhang, Ashley Ge, Oney, Steve, Wang, April Yi
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914292937261056
author Yang, Yinuo
Zhang, Ashley Ge
Oney, Steve
Wang, April Yi
author_facet Yang, Yinuo
Zhang, Ashley Ge
Oney, Steve
Wang, April Yi
contents Monitoring in-class programming exercises can help instructors identify struggling students and common challenges. However, understanding students' progress can be prohibitively difficult, particularly for multi-faceted problems that include multiple steps with complex interdependencies, have no predictable completion order, or involve evaluation criteria that are difficult to summarize across many students (e.g., exercises building interactive web-based user interfaces). We introduce SPARK, a coding exercise monitoring dashboard designed to address these challenges. SPARK allows instructors to flexibly group substeps into checkpoints based on exercise requirements, suggests automated tests for these checkpoints, and generates visualizations to track progress across steps. SPARK also allows instructors to inspect intermediate outputs, providing deeper insights into solution variations. We also construct a dataset of 40-minute keystroke coding data from N=22 learners solving two web programming exercises and provide empirical insights into the perceived usefulness of SPARK through a within-subjects evaluation with 16 programming instructors.
format Preprint
id arxiv_https___arxiv_org_abs_2601_22256
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SPARK: Real-Time Monitoring of Multi-Faceted Programming Exercises
Yang, Yinuo
Zhang, Ashley Ge
Oney, Steve
Wang, April Yi
Human-Computer Interaction
Software Engineering
Monitoring in-class programming exercises can help instructors identify struggling students and common challenges. However, understanding students' progress can be prohibitively difficult, particularly for multi-faceted problems that include multiple steps with complex interdependencies, have no predictable completion order, or involve evaluation criteria that are difficult to summarize across many students (e.g., exercises building interactive web-based user interfaces). We introduce SPARK, a coding exercise monitoring dashboard designed to address these challenges. SPARK allows instructors to flexibly group substeps into checkpoints based on exercise requirements, suggests automated tests for these checkpoints, and generates visualizations to track progress across steps. SPARK also allows instructors to inspect intermediate outputs, providing deeper insights into solution variations. We also construct a dataset of 40-minute keystroke coding data from N=22 learners solving two web programming exercises and provide empirical insights into the perceived usefulness of SPARK through a within-subjects evaluation with 16 programming instructors.
title SPARK: Real-Time Monitoring of Multi-Faceted Programming Exercises
topic Human-Computer Interaction
Software Engineering
url https://arxiv.org/abs/2601.22256