ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Han, Jieun, Yoo, Haneul, Myung, Junho, Kim, Minsun, Lee, Tak Yeon, Ahn, So-Yeon, Oh, Alice
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910374417137664
author Han, Jieun
Yoo, Haneul
Myung, Junho
Kim, Minsun
Lee, Tak Yeon
Ahn, So-Yeon
Oh, Alice
author_facet Han, Jieun
Yoo, Haneul
Myung, Junho
Kim, Minsun
Lee, Tak Yeon
Ahn, So-Yeon
Oh, Alice
contents The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's Dialogue Dataset As Revising an essay, which is collected from a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. The students were asked to revise their essays through dialogues with ChatGPT. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences. We analyze students' usage patterns and perceptions regarding generative AI with respect to their intent and satisfaction. As a foundational step, we establish baseline results for two pivotal tasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. We finally suggest further research to refine the integration of generative AI into education settings, outlining potential scenarios utilizing ChEDDAR. ChEDDAR is publicly available at https://github.com/zeunie/ChEDDAR.
format Preprint
id arxiv_https___arxiv_org_abs_2309_13243
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education
Han, Jieun
Yoo, Haneul
Myung, Junho
Kim, Minsun
Lee, Tak Yeon
Ahn, So-Yeon
Oh, Alice
Computation and Language
The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's Dialogue Dataset As Revising an essay, which is collected from a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. The students were asked to revise their essays through dialogues with ChatGPT. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences. We analyze students' usage patterns and perceptions regarding generative AI with respect to their intent and satisfaction. As a foundational step, we establish baseline results for two pivotal tasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. We finally suggest further research to refine the integration of generative AI into education settings, outlining potential scenarios utilizing ChEDDAR. ChEDDAR is publicly available at https://github.com/zeunie/ChEDDAR.
title ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education
topic Computation and Language
url https://arxiv.org/abs/2309.13243