Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprints

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qi, Minfeng, Cao, Zhongmin, Wang, Qin, Li, Ningran, Zhu, Tianqing
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908604173385728
author Qi, Minfeng
Cao, Zhongmin
Wang, Qin
Li, Ningran
Zhu, Tianqing
author_facet Qi, Minfeng
Cao, Zhongmin
Wang, Qin
Li, Ningran
Zhu, Tianqing
contents Preprint repositories become central infrastructures for scholarly communication. Their expansion transforms how research is circulated and evaluated before journal publication. Generative large language models (LLMs) introduce a further potential disruption by altering how manuscripts are written. While speculation abounds, systematic evidence of whether and how LLMs reshape scientific publishing remains limited. This paper addresses the gap through a large-scale analysis of more than 2.1 million preprints spanning 2016--2025 (115 months) across four major repositories (i.e., arXiv, bioRxiv, medRxiv, SocArXiv). We introduce a multi-level analytical framework that integrates interrupted time-series models, collaboration and productivity metrics, linguistic profiling, and topic modeling to assess changes in volume, authorship, style, and disciplinary orientation. Our findings reveal that LLMs have accelerated submission and revision cycles, modestly increased linguistic complexity, and disproportionately expanded AI-related topics, while computationally intensive fields benefit more than others. These results show that LLMs act less as universal disruptors than as selective catalysts, amplifying existing strengths and widening disciplinary divides. By documenting these dynamics, the paper provides the first empirical foundation for evaluating the influence of generative AI on academic publishing and highlights the need for governance frameworks that preserve trust, fairness, and accountability in an AI-enabled research ecosystem.
format Preprint
id arxiv_https___arxiv_org_abs_2510_17882
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprints
Qi, Minfeng
Cao, Zhongmin
Wang, Qin
Li, Ningran
Zhu, Tianqing
Computers and Society
Artificial Intelligence
Computation and Language
Digital Libraries
Preprint repositories become central infrastructures for scholarly communication. Their expansion transforms how research is circulated and evaluated before journal publication. Generative large language models (LLMs) introduce a further potential disruption by altering how manuscripts are written. While speculation abounds, systematic evidence of whether and how LLMs reshape scientific publishing remains limited. This paper addresses the gap through a large-scale analysis of more than 2.1 million preprints spanning 2016--2025 (115 months) across four major repositories (i.e., arXiv, bioRxiv, medRxiv, SocArXiv). We introduce a multi-level analytical framework that integrates interrupted time-series models, collaboration and productivity metrics, linguistic profiling, and topic modeling to assess changes in volume, authorship, style, and disciplinary orientation. Our findings reveal that LLMs have accelerated submission and revision cycles, modestly increased linguistic complexity, and disproportionately expanded AI-related topics, while computationally intensive fields benefit more than others. These results show that LLMs act less as universal disruptors than as selective catalysts, amplifying existing strengths and widening disciplinary divides. By documenting these dynamics, the paper provides the first empirical foundation for evaluating the influence of generative AI on academic publishing and highlights the need for governance frameworks that preserve trust, fairness, and accountability in an AI-enabled research ecosystem.
title Does GenAI Rewrite How We Write? An Empirical Study on Two-Million Preprints
topic Computers and Society
Artificial Intelligence
Computation and Language
Digital Libraries
url https://arxiv.org/abs/2510.17882