Beyond Access: Guided LLM Scaffolding for Independent Learning in Undergraduate Statistics

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Amanlou, Mohammad, Amou-Jafari, Yasaman, Livian, Mehrad, Boloukazari, Fatemeh, Bagheri, Fereshte, Bahrak, Behnam
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910278854115328
author Amanlou, Mohammad
Amou-Jafari, Yasaman
Livian, Mehrad
Boloukazari, Fatemeh
Bagheri, Fereshte
Bahrak, Behnam
author_facet Amanlou, Mohammad
Amou-Jafari, Yasaman
Livian, Mehrad
Boloukazari, Fatemeh
Bagheri, Fereshte
Bahrak, Behnam
contents Large language models (LLMs) are increasingly entering students' learning practices, but their educational value depends on whether they support reasoning or enable task completion without engagement. This study examines guided LLM use in an undergraduate Probability and Statistics course, focusing on the gap between assigned access and actual interaction quality. In a four-week quasi-experimental summer program, students were organized into three balanced conditions: no LLM access, unrestricted LLM access, and guided LLM access. The guided condition used the same LLM platform as the unrestricted condition, but students received explicit training and rules promoting reasoning-focused help-seeking, stepwise hints, verification, and ethical use. All quizzes and the delayed final exam were completed without LLM or external assistance, allowing us to distinguish AI-supported practice performance from independent learning. Results show that guided use was associated with clearer learning-oriented interaction patterns than unrestricted access, especially in prioritizing reasoning over final answers and requesting stepwise support. Guided-LLM students showed stronger no-help quiz performance during the intervention phase, whereas unrestricted access appeared more useful for assisted practice completion than for consistently improving independent performance. Available time measures did not support a simple duration-based explanation, and self-assessment calibration suggested better alignment between perceived and demonstrated understanding in the Guided-LLM condition. Overall, LLM access alone appears to be an incomplete educational intervention. For Artificial Intelligence in Education (AIED), the central design challenge is to scaffold how students use LLMs so that these systems function as partners in reasoning rather than answer-getting tools.
format Preprint
id arxiv_https___arxiv_org_abs_2606_01375
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Beyond Access: Guided LLM Scaffolding for Independent Learning in Undergraduate Statistics
Amanlou, Mohammad
Amou-Jafari, Yasaman
Livian, Mehrad
Boloukazari, Fatemeh
Bagheri, Fereshte
Bahrak, Behnam
Computers and Society
Artificial Intelligence
Large language models (LLMs) are increasingly entering students' learning practices, but their educational value depends on whether they support reasoning or enable task completion without engagement. This study examines guided LLM use in an undergraduate Probability and Statistics course, focusing on the gap between assigned access and actual interaction quality. In a four-week quasi-experimental summer program, students were organized into three balanced conditions: no LLM access, unrestricted LLM access, and guided LLM access. The guided condition used the same LLM platform as the unrestricted condition, but students received explicit training and rules promoting reasoning-focused help-seeking, stepwise hints, verification, and ethical use. All quizzes and the delayed final exam were completed without LLM or external assistance, allowing us to distinguish AI-supported practice performance from independent learning. Results show that guided use was associated with clearer learning-oriented interaction patterns than unrestricted access, especially in prioritizing reasoning over final answers and requesting stepwise support. Guided-LLM students showed stronger no-help quiz performance during the intervention phase, whereas unrestricted access appeared more useful for assisted practice completion than for consistently improving independent performance. Available time measures did not support a simple duration-based explanation, and self-assessment calibration suggested better alignment between perceived and demonstrated understanding in the Guided-LLM condition. Overall, LLM access alone appears to be an incomplete educational intervention. For Artificial Intelligence in Education (AIED), the central design challenge is to scaffold how students use LLMs so that these systems function as partners in reasoning rather than answer-getting tools.
title Beyond Access: Guided LLM Scaffolding for Independent Learning in Undergraduate Statistics
topic Computers and Society
Artificial Intelligence
url https://arxiv.org/abs/2606.01375