Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Naik, Atharva, Yin, Jessica Ruhan, Kamath, Anusha, Ma, Qianou, Wu, Sherry Tongshuang, Murray, Charles, Bogart, Christopher, Sakr, Majd, Rose, Carolyn P.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909183889113088
author Naik, Atharva
Yin, Jessica Ruhan
Kamath, Anusha
Ma, Qianou
Wu, Sherry Tongshuang
Murray, Charles
Bogart, Christopher
Sakr, Majd
Rose, Carolyn P.
author_facet Naik, Atharva
Yin, Jessica Ruhan
Kamath, Anusha
Ma, Qianou
Wu, Sherry Tongshuang
Murray, Charles
Bogart, Christopher
Sakr, Majd
Rose, Carolyn P.
contents An advantage of Large Language Models (LLMs) is their contextualization capability - providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard feedback. We present a design and evaluation of a proof-of-concept LLM application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT, which offers students contextualized reflection triggers during a collaborative query optimization task in database design. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context. We discuss in depth the exploration of the design space of the triggers and their correspondence with the learning objectives as well as the impact on student learning in a pilot study with 34 students.
format Preprint
id arxiv_https___arxiv_org_abs_2404_18262
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning
Naik, Atharva
Yin, Jessica Ruhan
Kamath, Anusha
Ma, Qianou
Wu, Sherry Tongshuang
Murray, Charles
Bogart, Christopher
Sakr, Majd
Rose, Carolyn P.
Artificial Intelligence
An advantage of Large Language Models (LLMs) is their contextualization capability - providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard feedback. We present a design and evaluation of a proof-of-concept LLM application to offer students dynamic and contextualized feedback. Specifically, we augment an Online Programming Exercise bot for a college-level Cloud Computing course with ChatGPT, which offers students contextualized reflection triggers during a collaborative query optimization task in database design. We demonstrate that LLMs can be used to generate highly situated reflection triggers that incorporate details of the collaborative discussion happening in context. We discuss in depth the exploration of the design space of the triggers and their correspondence with the learning objectives as well as the impact on student learning in a pilot study with 34 students.
title Generating Situated Reflection Triggers about Alternative Solution Paths: A Case Study of Generative AI for Computer-Supported Collaborative Learning
topic Artificial Intelligence
url https://arxiv.org/abs/2404.18262