LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913487489335296 |
|---|---|
| author | Han, Jieun Yoo, Haneul Myung, Junho Kim, Minsun Lim, Hyunseung Kim, Yoonsu Lee, Tak Yeon Hong, Hwajung Kim, Juho Ahn, So-Yeon Oh, Alice |
| author_facet | Han, Jieun Yoo, Haneul Myung, Junho Kim, Minsun Lim, Hyunseung Kim, Yoonsu Lee, Tak Yeon Hong, Hwajung Kim, Juho Ahn, So-Yeon Oh, Alice |
| contents | In the context of English as a Foreign Language (EFL) writing education, LLM-as-a-tutor can assist students by providing real-time feedback on their essays. However, challenges arise in assessing LLM-as-a-tutor due to differing standards between educational and general use cases. To bridge this gap, we integrate pedagogical principles to assess student-LLM interaction. First, we explore how LLMs can function as English tutors, providing effective essay feedback tailored to students. Second, we propose three metrics to evaluate LLM-as-a-tutor specifically designed for EFL writing education, emphasizing pedagogical aspects. In this process, EFL experts evaluate the feedback from LLM-as-a-tutor regarding quality and characteristics. On the other hand, EFL learners assess their learning outcomes from interaction with LLM-as-a-tutor. This approach lays the groundwork for developing LLMs-as-a-tutor tailored to the needs of EFL learners, advancing the effectiveness of writing education in this context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_05191 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction Han, Jieun Yoo, Haneul Myung, Junho Kim, Minsun Lim, Hyunseung Kim, Yoonsu Lee, Tak Yeon Hong, Hwajung Kim, Juho Ahn, So-Yeon Oh, Alice Computation and Language In the context of English as a Foreign Language (EFL) writing education, LLM-as-a-tutor can assist students by providing real-time feedback on their essays. However, challenges arise in assessing LLM-as-a-tutor due to differing standards between educational and general use cases. To bridge this gap, we integrate pedagogical principles to assess student-LLM interaction. First, we explore how LLMs can function as English tutors, providing effective essay feedback tailored to students. Second, we propose three metrics to evaluate LLM-as-a-tutor specifically designed for EFL writing education, emphasizing pedagogical aspects. In this process, EFL experts evaluate the feedback from LLM-as-a-tutor regarding quality and characteristics. On the other hand, EFL learners assess their learning outcomes from interaction with LLM-as-a-tutor. This approach lays the groundwork for developing LLMs-as-a-tutor tailored to the needs of EFL learners, advancing the effectiveness of writing education in this context. |
| title | LLM-as-a-tutor in EFL Writing Education: Focusing on Evaluation of Student-LLM Interaction |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2310.05191 |