"It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's Usage among Undergraduate Students in Computer Science

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Joshi, Ishika, Budhiraja, Ritvik, Akolekar, Harshal D, Challa, Jagat Sesh, Kumar, Dhruv
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916081258463232
author Joshi, Ishika
Budhiraja, Ritvik
Akolekar, Harshal D
Challa, Jagat Sesh
Kumar, Dhruv
author_facet Joshi, Ishika
Budhiraja, Ritvik
Akolekar, Harshal D
Challa, Jagat Sesh
Kumar, Dhruv
contents Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and solutions. However, these evaluations have predominantly been conducted by instructors and researchers, not considering the actual usage of LLMs by students. This study adopts a student-first approach to comprehensively understand how undergraduate computer science students utilize ChatGPT, a popular LLM, released by OpenAI. We employ a combination of student surveys and interviews to obtain valuable insights into the benefits, challenges, and suggested improvements related to ChatGPT. Our findings suggest that a majority of students (over 57%) have a convincingly positive outlook towards adopting ChatGPT as an aid in coursework-related tasks. However, our research also highlights various challenges that must be resolved for long-term acceptance of ChatGPT amongst students. The findings from this investigation have broader implications and may be applicable to other LLMs and their role in computing education.
format Preprint
id arxiv_https___arxiv_org_abs_2311_09651
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle "It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's Usage among Undergraduate Students in Computer Science
Joshi, Ishika
Budhiraja, Ritvik
Akolekar, Harshal D
Challa, Jagat Sesh
Kumar, Dhruv
Human-Computer Interaction
Artificial Intelligence
Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and solutions. However, these evaluations have predominantly been conducted by instructors and researchers, not considering the actual usage of LLMs by students. This study adopts a student-first approach to comprehensively understand how undergraduate computer science students utilize ChatGPT, a popular LLM, released by OpenAI. We employ a combination of student surveys and interviews to obtain valuable insights into the benefits, challenges, and suggested improvements related to ChatGPT. Our findings suggest that a majority of students (over 57%) have a convincingly positive outlook towards adopting ChatGPT as an aid in coursework-related tasks. However, our research also highlights various challenges that must be resolved for long-term acceptance of ChatGPT amongst students. The findings from this investigation have broader implications and may be applicable to other LLMs and their role in computing education.
title "It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's Usage among Undergraduate Students in Computer Science
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2311.09651