The Impact of AI Usage and Informativeness on Skill Development in Logical Reasoning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Shang, Yao, Hongyu, Belem, Catarina, Fu, Shuyuan, Steyvers, Mark, Smyth, Padhraic
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913151108251648
author Wu, Shang
Yao, Hongyu
Belem, Catarina
Fu, Shuyuan
Steyvers, Mark
Smyth, Padhraic
author_facet Wu, Shang
Yao, Hongyu
Belem, Catarina
Fu, Shuyuan
Steyvers, Mark
Smyth, Padhraic
contents Artificial intelligence (AI) is being increasingly integrated into human problem-solving, yet its effects on individual skill development remain unclear. We examine how both AI usage and informativeness can shape learning in the context of a controlled logical reasoning task with on-demand access to AI assistance. We find that greater AI usage is associated with weaker skill development: heavy AI users underperform relative to comparable peers, whereas light AI users perform similarly to matched users who do not use AI. We also find in our study that these patterns are mediated by AI informativeness. Low-information AI neither improves immediate performance nor preserves performance after AI assistance is removed, and is linked to weaker learning overall. On the other hand, high-information AI was found to improve short-run performance without reducing post-AI outcomes on average in our experiments, but with heterogeneous effects. Our findings in general suggest that AI can, depending on context, either complement human skill development by amplifying independent reasoning or can act as a substitute that undermines such reasoning, with the implication that regulating AI access and usage will be important for promoting skill development in the presence of AI assistance.
format Preprint
id arxiv_https___arxiv_org_abs_2605_21695
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The Impact of AI Usage and Informativeness on Skill Development in Logical Reasoning
Wu, Shang
Yao, Hongyu
Belem, Catarina
Fu, Shuyuan
Steyvers, Mark
Smyth, Padhraic
Artificial Intelligence
Human-Computer Interaction
Artificial intelligence (AI) is being increasingly integrated into human problem-solving, yet its effects on individual skill development remain unclear. We examine how both AI usage and informativeness can shape learning in the context of a controlled logical reasoning task with on-demand access to AI assistance. We find that greater AI usage is associated with weaker skill development: heavy AI users underperform relative to comparable peers, whereas light AI users perform similarly to matched users who do not use AI. We also find in our study that these patterns are mediated by AI informativeness. Low-information AI neither improves immediate performance nor preserves performance after AI assistance is removed, and is linked to weaker learning overall. On the other hand, high-information AI was found to improve short-run performance without reducing post-AI outcomes on average in our experiments, but with heterogeneous effects. Our findings in general suggest that AI can, depending on context, either complement human skill development by amplifying independent reasoning or can act as a substitute that undermines such reasoning, with the implication that regulating AI access and usage will be important for promoting skill development in the presence of AI assistance.
title The Impact of AI Usage and Informativeness on Skill Development in Logical Reasoning
topic Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2605.21695