Saved in:
Bibliographic Details
Main Authors: Yu, Renzhe, Xu, Zhen, CH-Wang, Sky, Arum, Richard
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.22282
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913570249244672
author Yu, Renzhe
Xu, Zhen
CH-Wang, Sky
Arum, Richard
author_facet Yu, Renzhe
Xu, Zhen
CH-Wang, Sky
Arum, Richard
contents The universal availability of ChatGPT and other similar tools since late 2022 has prompted tremendous public excitement and experimental effort about the potential of large language models (LLMs) to improve learning experience and outcomes, especially for learners from disadvantaged backgrounds. However, little research has systematically examined the real-world impacts of LLM availability on educational equity beyond theoretical projections and controlled studies of innovative LLM applications. To depict trends of post-LLM inequalities, we analyze 1,140,328 academic writing submissions from 16,791 college students across 2,391 courses between 2021 and 2024 at a public, minority-serving institution in the US. We find that students' overall writing quality gradually increased following the availability of LLMs and that the writing quality gaps between linguistically advantaged and disadvantaged students became increasingly narrower. However, this equitizing effect was more concentrated on students with higher socioeconomic status. These findings shed light on the digital divides in the era of LLMs and raise questions about the equity benefits of LLMs in early stages and highlight the need for researchers and practitioners on developing responsible practices to improve educational equity through LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2410_22282
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models
Yu, Renzhe
Xu, Zhen
CH-Wang, Sky
Arum, Richard
Computers and Society
The universal availability of ChatGPT and other similar tools since late 2022 has prompted tremendous public excitement and experimental effort about the potential of large language models (LLMs) to improve learning experience and outcomes, especially for learners from disadvantaged backgrounds. However, little research has systematically examined the real-world impacts of LLM availability on educational equity beyond theoretical projections and controlled studies of innovative LLM applications. To depict trends of post-LLM inequalities, we analyze 1,140,328 academic writing submissions from 16,791 college students across 2,391 courses between 2021 and 2024 at a public, minority-serving institution in the US. We find that students' overall writing quality gradually increased following the availability of LLMs and that the writing quality gaps between linguistically advantaged and disadvantaged students became increasingly narrower. However, this equitizing effect was more concentrated on students with higher socioeconomic status. These findings shed light on the digital divides in the era of LLMs and raise questions about the equity benefits of LLMs in early stages and highlight the need for researchers and practitioners on developing responsible practices to improve educational equity through LLMs.
title Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models
topic Computers and Society
url https://arxiv.org/abs/2410.22282