Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Phung, Tung, Choi, Heeryung, Wu, Mengyan, Singla, Adish, Brooks, Christopher
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916930931130368
author Phung, Tung
Choi, Heeryung
Wu, Mengyan
Singla, Adish
Brooks, Christopher
author_facet Phung, Tung
Choi, Heeryung
Wu, Mengyan
Singla, Adish
Brooks, Christopher
contents The growing adoption of generative AI in education highlights the need to integrate established pedagogical principles into AI-assisted learning environments. This study investigates the potential of metacognitive theory to inform AI-assisted programming education through a hint system designed around the metacognitive phases of planning, monitoring, and evaluation. Upon request, the system can provide three types of AI-generated hints--planning, debugging, and optimization--to guide students at different stages of problem-solving. Through a study with 102 students in an introductory data science programming course, we find that students perceive and engage with planning hints most highly, whereas optimization hints are rarely requested. We observe a consistent association between requesting planning hints and achieving higher grades across question difficulty and student competency. However, when facing harder tasks, students seek additional debugging but not more planning support. These insights contribute to the growing field of AI-assisted programming education by providing empirical evidence on the importance of pedagogical principles in AI-assisted learning.
format Preprint
id arxiv_https___arxiv_org_abs_2509_03171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education
Phung, Tung
Choi, Heeryung
Wu, Mengyan
Singla, Adish
Brooks, Christopher
Computers and Society
The growing adoption of generative AI in education highlights the need to integrate established pedagogical principles into AI-assisted learning environments. This study investigates the potential of metacognitive theory to inform AI-assisted programming education through a hint system designed around the metacognitive phases of planning, monitoring, and evaluation. Upon request, the system can provide three types of AI-generated hints--planning, debugging, and optimization--to guide students at different stages of problem-solving. Through a study with 102 students in an introductory data science programming course, we find that students perceive and engage with planning hints most highly, whereas optimization hints are rarely requested. We observe a consistent association between requesting planning hints and achieving higher grades across question difficulty and student competency. However, when facing harder tasks, students seek additional debugging but not more planning support. These insights contribute to the growing field of AI-assisted programming education by providing empirical evidence on the importance of pedagogical principles in AI-assisted learning.
title Plan More, Debug Less: Applying Metacognitive Theory to AI-Assisted Programming Education
topic Computers and Society
url https://arxiv.org/abs/2509.03171