AI-Tutoring in Software Engineering Education

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Frankford, Eduard, Sauerwein, Clemens, Bassner, Patrick, Krusche, Stephan, Breu, Ruth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911828381007872
author Frankford, Eduard
Sauerwein, Clemens
Bassner, Patrick
Krusche, Stephan
Breu, Ruth
author_facet Frankford, Eduard
Sauerwein, Clemens
Bassner, Patrick
Krusche, Stephan
Breu, Ruth
contents With the rapid advancement of artificial intelligence (AI) in various domains, the education sector is set for transformation. The potential of AI-driven tools in enhancing the learning experience, especially in programming, is immense. However, the scientific evaluation of Large Language Models (LLMs) used in Automated Programming Assessment Systems (APASs) as an AI-Tutor remains largely unexplored. Therefore, there is a need to understand how students interact with such AI-Tutors and to analyze their experiences. In this paper, we conducted an exploratory case study by integrating the GPT-3.5-Turbo model as an AI-Tutor within the APAS Artemis. Through a combination of empirical data collection and an exploratory survey, we identified different user types based on their interaction patterns with the AI-Tutor. Additionally, the findings highlight advantages, such as timely feedback and scalability. However, challenges like generic responses and students' concerns about a learning progress inhibition when using the AI-Tutor were also evident. This research adds to the discourse on AI's role in education.
format Preprint
id arxiv_https___arxiv_org_abs_2404_02548
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AI-Tutoring in Software Engineering Education
Frankford, Eduard
Sauerwein, Clemens
Bassner, Patrick
Krusche, Stephan
Breu, Ruth
Software Engineering
Artificial Intelligence
With the rapid advancement of artificial intelligence (AI) in various domains, the education sector is set for transformation. The potential of AI-driven tools in enhancing the learning experience, especially in programming, is immense. However, the scientific evaluation of Large Language Models (LLMs) used in Automated Programming Assessment Systems (APASs) as an AI-Tutor remains largely unexplored. Therefore, there is a need to understand how students interact with such AI-Tutors and to analyze their experiences. In this paper, we conducted an exploratory case study by integrating the GPT-3.5-Turbo model as an AI-Tutor within the APAS Artemis. Through a combination of empirical data collection and an exploratory survey, we identified different user types based on their interaction patterns with the AI-Tutor. Additionally, the findings highlight advantages, such as timely feedback and scalability. However, challenges like generic responses and students' concerns about a learning progress inhibition when using the AI-Tutor were also evident. This research adds to the discourse on AI's role in education.
title AI-Tutoring in Software Engineering Education
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2404.02548