The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jin, Yueqiao, Yang, Kaixun, Martinez-Maldonado, Roberto, Gašević, Dragan, Yan, Lixiang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914096523247616
author Jin, Yueqiao
Yang, Kaixun
Martinez-Maldonado, Roberto
Gašević, Dragan
Yan, Lixiang
author_facet Jin, Yueqiao
Yang, Kaixun
Martinez-Maldonado, Roberto
Gašević, Dragan
Yan, Lixiang
contents Generative AI (GenAI) tools are rapidly transforming higher education, yet little is known about how students' GenAI literacy shapes their ability to perform independently once such support is removed. This study investigates what we term the agency gap, introduced as the extent to which GenAI literacy predicts student writing performance in contexts that require self-initiation and regulation. Seventy-nine medical and nursing students completed multimodal academic writing tasks based on visual data, supported either by a reactive or proactive GenAI chatbot, followed by a parallel task without AI support. Writing was evaluated across insightfulness, visual data integration, organisation, linguistic quality, and critical thinking. Results showed that GenAI literacy predicted independent writing performance only in the reactive condition, where students had to actively mobilise their own strategies. Mediation analyses revealed no indirect effect via in-task performance, indicating that GenAI literacy acts as a direct, task-general competence rather than a proxy for domain knowledge or other literacies. By contrast, proactive scaffolding equalised outcomes across literacy levels, reducing reliance on learners' GenAI literacy. The agency gap highlights when GenAI literacy matters most, with implications for designing equitable AI-supported learning environments that both leverage and mitigate differences in students' GenAI literacy.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04398
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support
Jin, Yueqiao
Yang, Kaixun
Martinez-Maldonado, Roberto
Gašević, Dragan
Yan, Lixiang
Human-Computer Interaction
Computers and Society
Generative AI (GenAI) tools are rapidly transforming higher education, yet little is known about how students' GenAI literacy shapes their ability to perform independently once such support is removed. This study investigates what we term the agency gap, introduced as the extent to which GenAI literacy predicts student writing performance in contexts that require self-initiation and regulation. Seventy-nine medical and nursing students completed multimodal academic writing tasks based on visual data, supported either by a reactive or proactive GenAI chatbot, followed by a parallel task without AI support. Writing was evaluated across insightfulness, visual data integration, organisation, linguistic quality, and critical thinking. Results showed that GenAI literacy predicted independent writing performance only in the reactive condition, where students had to actively mobilise their own strategies. Mediation analyses revealed no indirect effect via in-task performance, indicating that GenAI literacy acts as a direct, task-general competence rather than a proxy for domain knowledge or other literacies. By contrast, proactive scaffolding equalised outcomes across literacy levels, reducing reliance on learners' GenAI literacy. The agency gap highlights when GenAI literacy matters most, with implications for designing equitable AI-supported learning environments that both leverage and mitigate differences in students' GenAI literacy.
title The Agency Gap: How Generative AI Literacy Shapes Independent Writing after AI Support
topic Human-Computer Interaction
Computers and Society
url https://arxiv.org/abs/2507.04398