Practice Less, Explain More: LLM-Supported Self-Explanation Improves Explanation Quality on Transfer Problems in Calculus

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Eason, Tang, Xinyi, Zhao, Yvonne, Chen, Meiyi, Elmir, Meryam, McLaughlin, Elizabeth, Yuan, Mingyu, Wang, Yumo, Agarwal, Shyam, Cochrane, Jared, Lin, Jionghao, Wu, Tongshuang, Koedinger, Ken
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917550020886528
author Chen, Eason
Tang, Xinyi
Zhao, Yvonne
Chen, Meiyi
Elmir, Meryam
McLaughlin, Elizabeth
Yuan, Mingyu
Wang, Yumo
Agarwal, Shyam
Cochrane, Jared
Lin, Jionghao
Wu, Tongshuang
Koedinger, Ken
author_facet Chen, Eason
Tang, Xinyi
Zhao, Yvonne
Chen, Meiyi
Elmir, Meryam
McLaughlin, Elizabeth
Yuan, Mingyu
Wang, Yumo
Agarwal, Shyam
Cochrane, Jared
Lin, Jionghao
Wu, Tongshuang
Koedinger, Ken
contents We conducted a between-subjects experiment (N=92) comparing three conditions in a calculus learning environment: no self-explanation (control), menu-based self-explanation, and open-ended self-explanation with LLM-generated feedback. All conditions showed positive learning gains within a fixed 60-minute practice session, with no significant between-condition differences in post-test performance. On transfer questions, the open-ended condition produced significantly higher-quality explanations than control on "Not Enough Information" (NEI) problems ($β$=+11.9 percentage points, $p$=.030), though the corresponding NEI multiple-choice accuracy advantage was not significant ($p$=.183). Moreover, across all post-test open-ended explanations, the open-ended condition showed a marginally significant advantage ($β$=+7.3%, $p$=.057). These findings suggest that LLM-supported open-ended self-explanation can improve explanation quality on NEI transfer problems, with weaker evidence across broader transfer explanation measures. Notably, these effects emerged even though learners in the open-ended condition completed substantially fewer practice problems within the same practice time.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00142
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Practice Less, Explain More: LLM-Supported Self-Explanation Improves Explanation Quality on Transfer Problems in Calculus
Chen, Eason
Tang, Xinyi
Zhao, Yvonne
Chen, Meiyi
Elmir, Meryam
McLaughlin, Elizabeth
Yuan, Mingyu
Wang, Yumo
Agarwal, Shyam
Cochrane, Jared
Lin, Jionghao
Wu, Tongshuang
Koedinger, Ken
Human-Computer Interaction
We conducted a between-subjects experiment (N=92) comparing three conditions in a calculus learning environment: no self-explanation (control), menu-based self-explanation, and open-ended self-explanation with LLM-generated feedback. All conditions showed positive learning gains within a fixed 60-minute practice session, with no significant between-condition differences in post-test performance. On transfer questions, the open-ended condition produced significantly higher-quality explanations than control on "Not Enough Information" (NEI) problems ($β$=+11.9 percentage points, $p$=.030), though the corresponding NEI multiple-choice accuracy advantage was not significant ($p$=.183). Moreover, across all post-test open-ended explanations, the open-ended condition showed a marginally significant advantage ($β$=+7.3%, $p$=.057). These findings suggest that LLM-supported open-ended self-explanation can improve explanation quality on NEI transfer problems, with weaker evidence across broader transfer explanation measures. Notably, these effects emerged even though learners in the open-ended condition completed substantially fewer practice problems within the same practice time.
title Practice Less, Explain More: LLM-Supported Self-Explanation Improves Explanation Quality on Transfer Problems in Calculus
topic Human-Computer Interaction
url https://arxiv.org/abs/2604.00142