Bridging Learnersourcing and AI: Exploring the Dynamics of Student-AI Collaborative Feedback Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Singh, Anjali, Brooks, Christopher, Wang, Xu, Li, Warren, Kim, Juho, Pandey, Deepti
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909129228943360
author Singh, Anjali
Brooks, Christopher
Wang, Xu
Li, Warren
Kim, Juho
Pandey, Deepti
author_facet Singh, Anjali
Brooks, Christopher
Wang, Xu
Li, Warren
Kim, Juho
Pandey, Deepti
contents This paper explores the space of optimizing feedback mechanisms in complex domains, such as data science, by combining two prevailing approaches: Artificial Intelligence (AI) and learnersourcing. Towards addressing the challenges posed by each approach, this work compares traditional learnersourcing with an AI-supported approach. We report on the results of a randomized controlled experiment conducted with 72 Master's level students in a data visualization course, comparing two conditions: students writing hints independently versus revising hints generated by GPT-4. The study aimed to evaluate the quality of learnersourced hints, examine the impact of student performance on hint quality, gauge learner preference for writing hints with or without AI support, and explore the potential of the student-AI collaborative exercise in fostering critical thinking about LLMs. Based on our findings, we provide insights for designing learnersourcing activities leveraging AI support and optimizing students' learning as they interact with LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2311_12148
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Bridging Learnersourcing and AI: Exploring the Dynamics of Student-AI Collaborative Feedback Generation
Singh, Anjali
Brooks, Christopher
Wang, Xu
Li, Warren
Kim, Juho
Pandey, Deepti
Human-Computer Interaction
This paper explores the space of optimizing feedback mechanisms in complex domains, such as data science, by combining two prevailing approaches: Artificial Intelligence (AI) and learnersourcing. Towards addressing the challenges posed by each approach, this work compares traditional learnersourcing with an AI-supported approach. We report on the results of a randomized controlled experiment conducted with 72 Master's level students in a data visualization course, comparing two conditions: students writing hints independently versus revising hints generated by GPT-4. The study aimed to evaluate the quality of learnersourced hints, examine the impact of student performance on hint quality, gauge learner preference for writing hints with or without AI support, and explore the potential of the student-AI collaborative exercise in fostering critical thinking about LLMs. Based on our findings, we provide insights for designing learnersourcing activities leveraging AI support and optimizing students' learning as they interact with LLMs.
title Bridging Learnersourcing and AI: Exploring the Dynamics of Student-AI Collaborative Feedback Generation
topic Human-Computer Interaction
url https://arxiv.org/abs/2311.12148