Which Feedback Works for Whom? Differential Effects of LLM-Generated Feedback Elements Across Learner Profiles
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910020045635584 |
|---|---|
| author | Furuhashi, Momoka Nakayama, Kouta Kawai, Noboru Kodama, Takashi Sugawara, Saku Takami, Kyosuke |
| author_facet | Furuhashi, Momoka Nakayama, Kouta Kawai, Noboru Kodama, Takashi Sugawara, Saku Takami, Kyosuke |
| contents | Large language models (LLMs) show promise for automatically generating feedback in education settings. However, it remains unclear how specific feedback elements, such as tone and information coverage, contribute to learning outcomes and learner acceptance, particularly across learners with different personality traits. In this study, we define six feedback elements and generate feedback for multiple-choice biology questions using GPT-5. We conduct a learning experiment with 321 first-year high school students and evaluate feedback effectiveness using two learning outcomes measures and subjective evaluations across six criteria. We further analyze differences in how feedback acceptance varies across learners based on Big Five personality traits. Our results show that effective feedback elements share common patterns supporting learning outcomes, while learners' subjective preferences differ across personality-based clusters. These findings highlight the importance of selecting and adapting feedback elements according to learners' personality traits when we design LLM-generated feedback, and provide practical implications for personalized feedback design in education. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_11650 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Which Feedback Works for Whom? Differential Effects of LLM-Generated Feedback Elements Across Learner Profiles Furuhashi, Momoka Nakayama, Kouta Kawai, Noboru Kodama, Takashi Sugawara, Saku Takami, Kyosuke Computation and Language Large language models (LLMs) show promise for automatically generating feedback in education settings. However, it remains unclear how specific feedback elements, such as tone and information coverage, contribute to learning outcomes and learner acceptance, particularly across learners with different personality traits. In this study, we define six feedback elements and generate feedback for multiple-choice biology questions using GPT-5. We conduct a learning experiment with 321 first-year high school students and evaluate feedback effectiveness using two learning outcomes measures and subjective evaluations across six criteria. We further analyze differences in how feedback acceptance varies across learners based on Big Five personality traits. Our results show that effective feedback elements share common patterns supporting learning outcomes, while learners' subjective preferences differ across personality-based clusters. These findings highlight the importance of selecting and adapting feedback elements according to learners' personality traits when we design LLM-generated feedback, and provide practical implications for personalized feedback design in education. |
| title | Which Feedback Works for Whom? Differential Effects of LLM-Generated Feedback Elements Across Learner Profiles |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2602.11650 |