Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Weitekamp, Daniel, MacLellan, Christopher, Harpstead, Erik, Koedinger, Kenneth
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915288424906752
author Weitekamp, Daniel
MacLellan, Christopher
Harpstead, Erik
Koedinger, Kenneth
author_facet Weitekamp, Daniel
MacLellan, Christopher
Harpstead, Erik
Koedinger, Kenneth
contents Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective function. This raises the question: might human learners' relatively rapid learning from just tens of examples instead of tens of thousands in data-driven deep learning arise from our ability to use multiple specialized mechanisms of learning in combination? We investigate this question through an ablation analysis of inductive human learning simulations in online tutoring environments. Comparing reinforcement learning to a more data-efficient 3-mechanism symbolic rule induction approach, we find that decomposing learning into multiple distinct mechanisms significantly improves data efficiency, bringing it in line with human learning. Furthermore, we show that this decomposition has a greater impact on efficiency than the distinction between symbolic and subsymbolic learning alone. Efforts to align data-driven machine learning with human learning often overlook the stark difference in learning efficiency. Our findings suggest that integrating multiple specialized learning mechanisms may be key to bridging this gap.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10422
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
Weitekamp, Daniel
MacLellan, Christopher
Harpstead, Erik
Koedinger, Kenneth
Machine Learning
Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective function. This raises the question: might human learners' relatively rapid learning from just tens of examples instead of tens of thousands in data-driven deep learning arise from our ability to use multiple specialized mechanisms of learning in combination? We investigate this question through an ablation analysis of inductive human learning simulations in online tutoring environments. Comparing reinforcement learning to a more data-efficient 3-mechanism symbolic rule induction approach, we find that decomposing learning into multiple distinct mechanisms significantly improves data efficiency, bringing it in line with human learning. Furthermore, we show that this decomposition has a greater impact on efficiency than the distinction between symbolic and subsymbolic learning alone. Efforts to align data-driven machine learning with human learning often overlook the stark difference in learning efficiency. Our findings suggest that integrating multiple specialized learning mechanisms may be key to bridging this gap.
title Decomposed Inductive Procedure Learning: Learning Academic Tasks with Human-Like Data Efficiency
topic Machine Learning
url https://arxiv.org/abs/2505.10422