Enhancing Software Testing Education: Understanding Where Students Struggle

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Andleeb, Shiza, Mendoza, Teo, Cordova, Lucas, Walia, Gursimran, Carver, Jeffrey C.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915528538324992
author Andleeb, Shiza
Mendoza, Teo
Cordova, Lucas
Walia, Gursimran
Carver, Jeffrey C.
author_facet Andleeb, Shiza
Mendoza, Teo
Cordova, Lucas
Walia, Gursimran
Carver, Jeffrey C.
contents Effective software testing is critical for producing reliable and secure software, yet many computer science students struggle to master the foundational concepts required to construct comprehensive test suites. While automated feedback tools are widely used to support student learning, it remains unclear which testing concepts are most frequently misunderstood and how these misunderstandings are reflected in students' test suite revisions. This study examines the specific testing concepts that lead students to make ineffective changes, those that fail to improve code coverage, during test suite development. Leveraging an automated feedback tool in a senior-level software testing course, we analyzed student submissions from two assignments to identify prevalent conceptual gaps and patterns of unproductive modification. Our results reveal that decision coverage and exception handling are persistent challenges, and that students most often make superficial or method-level changes that do not enhance coverage. These findings provide actionable insights for educators, researchers, and tool designers. By pinpointing the concepts that most often contribute to poor testing outcomes, we can refine feedback systems, target instruction to address persistent misconceptions, and more effectively support students in developing robust, maintainable test suites.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00957
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Software Testing Education: Understanding Where Students Struggle
Andleeb, Shiza
Mendoza, Teo
Cordova, Lucas
Walia, Gursimran
Carver, Jeffrey C.
Software Engineering
Effective software testing is critical for producing reliable and secure software, yet many computer science students struggle to master the foundational concepts required to construct comprehensive test suites. While automated feedback tools are widely used to support student learning, it remains unclear which testing concepts are most frequently misunderstood and how these misunderstandings are reflected in students' test suite revisions. This study examines the specific testing concepts that lead students to make ineffective changes, those that fail to improve code coverage, during test suite development. Leveraging an automated feedback tool in a senior-level software testing course, we analyzed student submissions from two assignments to identify prevalent conceptual gaps and patterns of unproductive modification. Our results reveal that decision coverage and exception handling are persistent challenges, and that students most often make superficial or method-level changes that do not enhance coverage. These findings provide actionable insights for educators, researchers, and tool designers. By pinpointing the concepts that most often contribute to poor testing outcomes, we can refine feedback systems, target instruction to address persistent misconceptions, and more effectively support students in developing robust, maintainable test suites.
title Enhancing Software Testing Education: Understanding Where Students Struggle
topic Software Engineering
url https://arxiv.org/abs/2510.00957