Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kim, Minsun, Kim, SeonGyeom, Lee, Suyoun, Yoon, Yoosang, Myung, Junho, Yoo, Haneul, Lim, Hyunseung, Han, Jieun, Kim, Yoonsu, Ahn, So-Yeon, Kim, Juho, Oh, Alice, Hong, Hwajung, Lee, Tak Yeon
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913552217931776
author Kim, Minsun
Kim, SeonGyeom
Lee, Suyoun
Yoon, Yoosang
Myung, Junho
Yoo, Haneul
Lim, Hyunseung
Han, Jieun
Kim, Yoonsu
Ahn, So-Yeon
Kim, Juho
Oh, Alice
Hong, Hwajung
Lee, Tak Yeon
author_facet Kim, Minsun
Kim, SeonGyeom
Lee, Suyoun
Yoon, Yoosang
Myung, Junho
Yoo, Haneul
Lim, Hyunseung
Han, Jieun
Kim, Yoonsu
Ahn, So-Yeon
Kim, Juho
Oh, Alice
Hong, Hwajung
Lee, Tak Yeon
contents While ChatGPT has significantly impacted education by offering personalized resources for students, its integration into educational settings poses unprecedented risks, such as inaccuracies and biases in AI-generated content, plagiarism and over-reliance on AI, and privacy and security issues. To help teachers address such risks, we conducted a two-phase iterative design process that comprises surveys, interviews, and prototype demonstration involving six EFL (English as a Foreign Language) teachers, who integrated ChatGPT into semester-long English essay writing classes. Based on the needs identified during the initial survey and interviews, we developed a prototype of Prompt Analytics Dashboard (PAD) that integrates the essay editing history and chat logs between students and ChatGPT. Teacher's feedback on the prototype informs additional features and unmet needs for designing future PAD, which helps them (1) analyze contextual analysis of student behaviors, (2) design an overall learning loop, and (3) develop their teaching skills.
format Preprint
id arxiv_https___arxiv_org_abs_2405_19691
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing
Kim, Minsun
Kim, SeonGyeom
Lee, Suyoun
Yoon, Yoosang
Myung, Junho
Yoo, Haneul
Lim, Hyunseung
Han, Jieun
Kim, Yoonsu
Ahn, So-Yeon
Kim, Juho
Oh, Alice
Hong, Hwajung
Lee, Tak Yeon
Human-Computer Interaction
While ChatGPT has significantly impacted education by offering personalized resources for students, its integration into educational settings poses unprecedented risks, such as inaccuracies and biases in AI-generated content, plagiarism and over-reliance on AI, and privacy and security issues. To help teachers address such risks, we conducted a two-phase iterative design process that comprises surveys, interviews, and prototype demonstration involving six EFL (English as a Foreign Language) teachers, who integrated ChatGPT into semester-long English essay writing classes. Based on the needs identified during the initial survey and interviews, we developed a prototype of Prompt Analytics Dashboard (PAD) that integrates the essay editing history and chat logs between students and ChatGPT. Teacher's feedback on the prototype informs additional features and unmet needs for designing future PAD, which helps them (1) analyze contextual analysis of student behaviors, (2) design an overall learning loop, and (3) develop their teaching skills.
title Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writing
topic Human-Computer Interaction
url https://arxiv.org/abs/2405.19691