Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909466666991616 |
|---|---|
| author | Furuhashi, Momoka Funayama, Hiroaki Iwase, Yuya Matsubayashi, Yuichiroh Isobe, Yoriko Nagahama, Toru Sugawara, Saku Inui, Kentaro |
| author_facet | Furuhashi, Momoka Funayama, Hiroaki Iwase, Yuya Matsubayashi, Yuichiroh Isobe, Yoriko Nagahama, Toru Sugawara, Saku Inui, Kentaro |
| contents | Short-reading comprehension questions help students understand text structure but lack effective feedback. Students struggle to identify and correct errors, while manual feedback creation is labor-intensive. This highlights the need for automated feedback linking responses to a scoring rubric for deeper comprehension.
Despite advances in Natural Language Processing (NLP), research has focused on automatic grading, with limited work on feedback generation. To address this, we propose a system that generates feedback for student responses.
Our contributions are twofold. First, we introduce the first system for feedback on short-answer reading comprehension. These answers are derived from the text, requiring structural understanding. We propose an "answer diagnosis graph," integrating the text's logical structure with feedback templates. Using this graph and NLP techniques, we estimate students' comprehension and generate targeted feedback.
Second, we evaluate our feedback through an experiment with Japanese high school students (n=39). They answered two 70-80 word questions and were divided into two groups with minimal academic differences. One received a model answer, the other system-generated feedback. Both re-answered the questions, and we compared score changes. A questionnaire assessed perceptions and motivation.
Results showed no significant score improvement between groups, but system-generated feedback helped students identify errors and key points in the text. It also significantly increased motivation. However, further refinement is needed to enhance text structure understanding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_15777 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs Furuhashi, Momoka Funayama, Hiroaki Iwase, Yuya Matsubayashi, Yuichiroh Isobe, Yoriko Nagahama, Toru Sugawara, Saku Inui, Kentaro Computation and Language Short-reading comprehension questions help students understand text structure but lack effective feedback. Students struggle to identify and correct errors, while manual feedback creation is labor-intensive. This highlights the need for automated feedback linking responses to a scoring rubric for deeper comprehension. Despite advances in Natural Language Processing (NLP), research has focused on automatic grading, with limited work on feedback generation. To address this, we propose a system that generates feedback for student responses. Our contributions are twofold. First, we introduce the first system for feedback on short-answer reading comprehension. These answers are derived from the text, requiring structural understanding. We propose an "answer diagnosis graph," integrating the text's logical structure with feedback templates. Using this graph and NLP techniques, we estimate students' comprehension and generate targeted feedback. Second, we evaluate our feedback through an experiment with Japanese high school students (n=39). They answered two 70-80 word questions and were divided into two groups with minimal academic differences. One received a model answer, the other system-generated feedback. Both re-answered the questions, and we compared score changes. A questionnaire assessed perceptions and motivation. Results showed no significant score improvement between groups, but system-generated feedback helped students identify errors and key points in the text. It also significantly increased motivation. However, further refinement is needed to enhance text structure understanding. |
| title | Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2501.15777 |