Saved in:
Bibliographic Details
Main Authors: Jaipersaud, Brandon, Zhang, Paul, Ba, Jimmy, Petersen, Andrew, Zhang, Lisa, Zhang, Michael R.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.21170
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We propose and evaluate a question-answering system that uses decomposed prompting to classify and answer student questions on a course discussion board. Our system uses a large language model (LLM) to classify questions into one of four types: conceptual, homework, logistics, and not answerable. This enables us to employ a different strategy for answering questions that fall under different types. Using a variant of GPT-3, we achieve $81\%$ classification accuracy. We discuss our system's performance on answering conceptual questions from a machine learning course and various failure modes.