Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course?
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911761656971264 |
|---|---|
| author | Anishka Mehta, Atharva Gupta, Nipun Balachandran, Aarav Kumar, Dhruv Jalote, Pankaj |
| author_facet | Anishka Mehta, Atharva Gupta, Nipun Balachandran, Aarav Kumar, Dhruv Jalote, Pankaj |
| contents | The emergence of Large language models (LLMs) is expected to have a major impact on education. This paper explores the potential of using ChatGPT, an LLM, as a virtual Teaching Assistant (TA) in an Introductory Programming Course. We evaluate ChatGPT's capabilities by comparing its performance with that of human TAs in some of the important TA functions. The TA functions which we focus on include (1) grading student code submissions, and (2) providing feedback to undergraduate students in an introductory programming course. Firstly, we assess ChatGPT's proficiency in grading student code submissions using a given grading rubric and compare its performance with the grades assigned by human TAs. Secondly, we analyze the quality and relevance of the feedback provided by ChatGPT. This evaluation considers how well ChatGPT addresses mistakes and offers suggestions for improvement in student solutions from both code correctness and code quality perspectives. We conclude with a discussion on the implications of integrating ChatGPT into computing education for automated grading, personalized learning experiences, and instructional support. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_07343 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course? Anishka Mehta, Atharva Gupta, Nipun Balachandran, Aarav Kumar, Dhruv Jalote, Pankaj Human-Computer Interaction Artificial Intelligence The emergence of Large language models (LLMs) is expected to have a major impact on education. This paper explores the potential of using ChatGPT, an LLM, as a virtual Teaching Assistant (TA) in an Introductory Programming Course. We evaluate ChatGPT's capabilities by comparing its performance with that of human TAs in some of the important TA functions. The TA functions which we focus on include (1) grading student code submissions, and (2) providing feedback to undergraduate students in an introductory programming course. Firstly, we assess ChatGPT's proficiency in grading student code submissions using a given grading rubric and compare its performance with the grades assigned by human TAs. Secondly, we analyze the quality and relevance of the feedback provided by ChatGPT. This evaluation considers how well ChatGPT addresses mistakes and offers suggestions for improvement in student solutions from both code correctness and code quality perspectives. We conclude with a discussion on the implications of integrating ChatGPT into computing education for automated grading, personalized learning experiences, and instructional support. |
| title | Can ChatGPT Play the Role of a Teaching Assistant in an Introductory Programming Course? |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2312.07343 |