Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.15112 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917962476158976 |
|---|---|
| author | Saborido-Fernández, Pablo Fernández-Pichel, Marcos Losada, David E. |
| author_facet | Saborido-Fernández, Pablo Fernández-Pichel, Marcos Losada, David E. |
| contents | Evaluating the capabilities of Large Language Models (LLMs) to assist teachers and students in educational tasks is receiving increasing attention. In this paper, we assess ChatGPT's capacities to solve and grade real programming exams, from an accredited BSc degree in Computer Science, written in Spanish. Our findings suggest that this AI model is only effective for solving simple coding tasks. Its proficiency in tackling complex problems or evaluating solutions authored by others are far from effective. As part of this research, we also release a new corpus of programming tasks and the corresponding prompts for solving the problems or grading the solutions. This resource can be further exploited by other research teams. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_15112 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ChatGPT as a Solver and Grader of Programming Exams written in Spanish Saborido-Fernández, Pablo Fernández-Pichel, Marcos Losada, David E. Artificial Intelligence Evaluating the capabilities of Large Language Models (LLMs) to assist teachers and students in educational tasks is receiving increasing attention. In this paper, we assess ChatGPT's capacities to solve and grade real programming exams, from an accredited BSc degree in Computer Science, written in Spanish. Our findings suggest that this AI model is only effective for solving simple coding tasks. Its proficiency in tackling complex problems or evaluating solutions authored by others are far from effective. As part of this research, we also release a new corpus of programming tasks and the corresponding prompts for solving the problems or grading the solutions. This resource can be further exploited by other research teams. |
| title | ChatGPT as a Solver and Grader of Programming Exams written in Spanish |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2409.15112 |