Saved in:
Bibliographic Details
Main Authors: Dixit, Prakhar, Oates, Tim
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.13293
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910691741401088
author Dixit, Prakhar
Oates, Tim
author_facet Dixit, Prakhar
Oates, Tim
contents Many students struggle with math word problems (MWPs), often finding it difficult to identify key information and select the appropriate mathematical operations. Schema-based instruction (SBI) is an evidence-based strategy that helps students categorize problems based on their structure, improving problem-solving accuracy. Building on this, we propose a Schema-Based Instruction Retrieval-Augmented Generation (SBI-RAG) framework that incorporates a large language model (LLM). Our approach emphasizes step-by-step reasoning by leveraging schemas to guide solution generation. We evaluate its performance on the GSM8K dataset, comparing it with GPT-4 and GPT-3.5 Turbo, and introduce a "reasoning score" metric to assess solution quality. Our findings suggest that SBI-RAG enhances reasoning clarity and facilitates a more structured problem-solving process potentially providing educational benefits for students.
format Preprint
id arxiv_https___arxiv_org_abs_2410_13293
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generation
Dixit, Prakhar
Oates, Tim
Machine Learning
Artificial Intelligence
Information Retrieval
Many students struggle with math word problems (MWPs), often finding it difficult to identify key information and select the appropriate mathematical operations. Schema-based instruction (SBI) is an evidence-based strategy that helps students categorize problems based on their structure, improving problem-solving accuracy. Building on this, we propose a Schema-Based Instruction Retrieval-Augmented Generation (SBI-RAG) framework that incorporates a large language model (LLM). Our approach emphasizes step-by-step reasoning by leveraging schemas to guide solution generation. We evaluate its performance on the GSM8K dataset, comparing it with GPT-4 and GPT-3.5 Turbo, and introduce a "reasoning score" metric to assess solution quality. Our findings suggest that SBI-RAG enhances reasoning clarity and facilitates a more structured problem-solving process potentially providing educational benefits for students.
title SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented Generation
topic Machine Learning
Artificial Intelligence
Information Retrieval
url https://arxiv.org/abs/2410.13293