Difficulty Generating Factors for Context-free Language Construction Assignments

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Schmalstieg, Florian, Schmellenkamp, Marko, Schwerter, Jakob, Zeume, Thomas
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915423683870720
author Schmalstieg, Florian
Schmellenkamp, Marko
Schwerter, Jakob
Zeume, Thomas
author_facet Schmalstieg, Florian
Schmellenkamp, Marko
Schwerter, Jakob
Zeume, Thomas
contents Computer science students often struggle with abstract theoretical concepts, particularly in introductory courses on theoretical computer science. One such challenge is understanding context-free languages and their various representations. In this study we investigate factors that influence the difficulty of constructing context-free grammars and pushdown automata for context-free languages. We propose two potential difficulty generating factors targeting how a language is presented to students: representation in natural language and as a verbose set notation. Furthermore, we propose two factors targeting the structure of the given context-free language: nesting of constructs and insertion of multiplicities. We conducted a controlled experiment using within-subject randomization in an interactive learning system, testing the proposed difficulty factors for constructing context-free grammars and pushdown automata. Our results suggest that three of the four factors significantly influence students' objective performance in solving exercises for constructing context-free grammars, while students' perceived difficulties only partly align with the objective performance measures. The findings for pushdown automata tasks differed markedly from those for context-free grammar tasks. Our variations either had negligible effects or, in some cases, even reduced difficulty. Thus, no robust statistical conclusions can be made for pushdown automata tasks. The results lay foundations for learning systems that adaptively choose appropriate exercises for individual students.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01735
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Difficulty Generating Factors for Context-free Language Construction Assignments
Schmalstieg, Florian
Schmellenkamp, Marko
Schwerter, Jakob
Zeume, Thomas
Computers and Society
Formal Languages and Automata Theory
K.3.2; F.4.3; K.3.1
Computer science students often struggle with abstract theoretical concepts, particularly in introductory courses on theoretical computer science. One such challenge is understanding context-free languages and their various representations. In this study we investigate factors that influence the difficulty of constructing context-free grammars and pushdown automata for context-free languages. We propose two potential difficulty generating factors targeting how a language is presented to students: representation in natural language and as a verbose set notation. Furthermore, we propose two factors targeting the structure of the given context-free language: nesting of constructs and insertion of multiplicities. We conducted a controlled experiment using within-subject randomization in an interactive learning system, testing the proposed difficulty factors for constructing context-free grammars and pushdown automata. Our results suggest that three of the four factors significantly influence students' objective performance in solving exercises for constructing context-free grammars, while students' perceived difficulties only partly align with the objective performance measures. The findings for pushdown automata tasks differed markedly from those for context-free grammar tasks. Our variations either had negligible effects or, in some cases, even reduced difficulty. Thus, no robust statistical conclusions can be made for pushdown automata tasks. The results lay foundations for learning systems that adaptively choose appropriate exercises for individual students.
title Difficulty Generating Factors for Context-free Language Construction Assignments
topic Computers and Society
Formal Languages and Automata Theory
K.3.2; F.4.3; K.3.1
url https://arxiv.org/abs/2508.01735