Saved in:
Bibliographic Details
Main Authors: Divekar, Rahul R., Guerra, Sophia, Gonzalez, Lisette, Boos, Natasha, Zhou, Helen
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.02622
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912503558045696
author Divekar, Rahul R.
Guerra, Sophia
Gonzalez, Lisette
Boos, Natasha
Zhou, Helen
author_facet Divekar, Rahul R.
Guerra, Sophia
Gonzalez, Lisette
Boos, Natasha
Zhou, Helen
contents Large language models (LLMs) are transforming how students learn by providing readily available tools that can quickly augment or complete various learning activities with non-trivial performance. Similar paradigm shifts have occurred in the past with the introduction of search engines and Wikipedia, which replaced or supplemented traditional information sources such as libraries and books. This study investigates the potential for LLMs to represent the next shift in learning, focusing on their role in information discovery and synthesis compared to existing technologies, such as search engines. Using a within-subjects, counterbalanced design, participants learned new topics using a search engine (Google) and an LLM (ChatGPT). Post-task follow-up interviews explored students' reflections, preferences, pain points, and overall perceptions. We present analysis of their responses that show nuanced insights into when, why, and how students prefer LLMs over search engines, offering implications for educators, policymakers, and technology developers navigating the evolving educational landscape.
format Preprint
id arxiv_https___arxiv_org_abs_2504_02622
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring undercurrents of learning tensions in an LLM-enhanced landscape: A student-centered qualitative perspective on LLM vs Search
Divekar, Rahul R.
Guerra, Sophia
Gonzalez, Lisette
Boos, Natasha
Zhou, Helen
Human-Computer Interaction
Large language models (LLMs) are transforming how students learn by providing readily available tools that can quickly augment or complete various learning activities with non-trivial performance. Similar paradigm shifts have occurred in the past with the introduction of search engines and Wikipedia, which replaced or supplemented traditional information sources such as libraries and books. This study investigates the potential for LLMs to represent the next shift in learning, focusing on their role in information discovery and synthesis compared to existing technologies, such as search engines. Using a within-subjects, counterbalanced design, participants learned new topics using a search engine (Google) and an LLM (ChatGPT). Post-task follow-up interviews explored students' reflections, preferences, pain points, and overall perceptions. We present analysis of their responses that show nuanced insights into when, why, and how students prefer LLMs over search engines, offering implications for educators, policymakers, and technology developers navigating the evolving educational landscape.
title Exploring undercurrents of learning tensions in an LLM-enhanced landscape: A student-centered qualitative perspective on LLM vs Search
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.02622