Salvato in:
Dettagli Bibliografici
Autori principali: Kumar, Aayush, Prol, Daniel, Alipour, Amin, Ragavan, Sruti Srinivasa
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2501.11935
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910889330868224
author Kumar, Aayush
Prol, Daniel
Alipour, Amin
Ragavan, Sruti Srinivasa
author_facet Kumar, Aayush
Prol, Daniel
Alipour, Amin
Ragavan, Sruti Srinivasa
contents LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective students are and what strategies students use while learning with LLMs. Since the majority of students' experiences in online self-learning have come through using search engines such as Google, evaluating AI tools in this context can help us address these gaps. In this mixed methods research, we conducted an exploratory within-subjects study to understand how CS2 students learn programming concepts using both LLMs as well as traditional online methods such as educational websites and videos to examine how students approach learning within and across both scenarios. We discovered that students found it easier to learn a more difficult concept using traditional methods than using ChatGPT. We also found that students ask fewer follow-ups and use more keyword-based queries for search engines while their prompts to LLMs tend to explicitly ask for information.
format Preprint
id arxiv_https___arxiv_org_abs_2501_11935
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes
Kumar, Aayush
Prol, Daniel
Alipour, Amin
Ragavan, Sruti Srinivasa
Human-Computer Interaction
Artificial Intelligence
LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective students are and what strategies students use while learning with LLMs. Since the majority of students' experiences in online self-learning have come through using search engines such as Google, evaluating AI tools in this context can help us address these gaps. In this mixed methods research, we conducted an exploratory within-subjects study to understand how CS2 students learn programming concepts using both LLMs as well as traditional online methods such as educational websites and videos to examine how students approach learning within and across both scenarios. We discovered that students found it easier to learn a more difficult concept using traditional methods than using ChatGPT. We also found that students ask fewer follow-ups and use more keyword-based queries for search engines while their prompts to LLMs tend to explicitly ask for information.
title To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2501.11935