Impact of Criterion-Based Reflection on Prospective Physics Teachers' Perceptions of ChatGPT-Generated Content

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sadidi, Farahnaz, Prestel, Thomas
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916420679368704
author Sadidi, Farahnaz
Prestel, Thomas
author_facet Sadidi, Farahnaz
Prestel, Thomas
contents ChatGPT has significantly shaped digital transformation discussions. Its widespread testing and ongoing optimization highlight the need to assess its capabilities and encourage critical reflection. This study explores how students' critical reflection on ChatGPT-generated content impacts their perceptions of its answer quality and further use. Involving 39 prospective physics teachers, the study assessed their evaluations of ChatGPT's answers to didactical tasks using predefined criteria, in this paper referred as the criterion-based evaluation approach. Pre- and post-questionnaires, with a 5-point ranking scale and open-ended questions, evaluated students' perceptions of ChatGPT's helpfulness and quality. Results showed that critical reflection shifted students' perception of answer quality and increased their awareness of ChatGPT's limitations. Three perspectives on ChatGPT's further use emerged: extreme positive, extreme negative, and balanced. The extreme positive perspective indicated confirmation bias, where the positive prior experiences of students with ChatGPT influenced their evaluations. The findings highlight the need to foster critical thinking and media literacy in teacher training programs to help educators effectively integrate such tools.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01354
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Impact of Criterion-Based Reflection on Prospective Physics Teachers' Perceptions of ChatGPT-Generated Content
Sadidi, Farahnaz
Prestel, Thomas
Physics Education
ChatGPT has significantly shaped digital transformation discussions. Its widespread testing and ongoing optimization highlight the need to assess its capabilities and encourage critical reflection. This study explores how students' critical reflection on ChatGPT-generated content impacts their perceptions of its answer quality and further use. Involving 39 prospective physics teachers, the study assessed their evaluations of ChatGPT's answers to didactical tasks using predefined criteria, in this paper referred as the criterion-based evaluation approach. Pre- and post-questionnaires, with a 5-point ranking scale and open-ended questions, evaluated students' perceptions of ChatGPT's helpfulness and quality. Results showed that critical reflection shifted students' perception of answer quality and increased their awareness of ChatGPT's limitations. Three perspectives on ChatGPT's further use emerged: extreme positive, extreme negative, and balanced. The extreme positive perspective indicated confirmation bias, where the positive prior experiences of students with ChatGPT influenced their evaluations. The findings highlight the need to foster critical thinking and media literacy in teacher training programs to help educators effectively integrate such tools.
title Impact of Criterion-Based Reflection on Prospective Physics Teachers' Perceptions of ChatGPT-Generated Content
topic Physics Education
url https://arxiv.org/abs/2410.01354