Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review
Fuente:
arXiv
Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914407496286208 |
|---|---|
| author | Kayadibi, Seyma Yaman |
| author_facet | Kayadibi, Seyma Yaman |
| contents | The rapid development of generative artificial intelligence (GenAI) tools such as ChatGPT has intensified interest in their role in higher education, particularly in how students perceive and use them and how these perceptions may relate to educational outcomes. This study employs a hybrid methodological approach that combines a PRISMA-guided systematic literature review with simulation-based modeling to examine student perceptions of GenAI in higher education. Nineteen empirical articles published between 2023 and 2025 were identified through a Scopus-based review, and thematic synthesis was used to organize the emerging patterns in the literature. Of these, six studies reported item-level means and standard deviations suitable for probabilistic modeling. From this subset, one well-structured Likert-scale dataset was selected as a canonical example for inverse-variance-weighted Monte Carlo simulation. The simulation generated a composite perception-based Success Score, enabling estimation of both central tendency and uncertainty under different thematic configurations. The findings indicate that usability-related factors, particularly System Efficiency and Learning Burden, exert the greatest influence on the composite score under the specified weighting scheme, while other themes also contribute positively but more modestly. The study offers a transparent and privacy-preserving bridge between thematic synthesis and predictive probabilistic modeling, providing a reproducible framework for linking GenAI perceptions to educational outcomes in future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_01062 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review Kayadibi, Seyma Yaman Computers and Society Artificial Intelligence 62P25, 65C05 K.3.1; H.5.2; I.2.7 The rapid development of generative artificial intelligence (GenAI) tools such as ChatGPT has intensified interest in their role in higher education, particularly in how students perceive and use them and how these perceptions may relate to educational outcomes. This study employs a hybrid methodological approach that combines a PRISMA-guided systematic literature review with simulation-based modeling to examine student perceptions of GenAI in higher education. Nineteen empirical articles published between 2023 and 2025 were identified through a Scopus-based review, and thematic synthesis was used to organize the emerging patterns in the literature. Of these, six studies reported item-level means and standard deviations suitable for probabilistic modeling. From this subset, one well-structured Likert-scale dataset was selected as a canonical example for inverse-variance-weighted Monte Carlo simulation. The simulation generated a composite perception-based Success Score, enabling estimation of both central tendency and uncertainty under different thematic configurations. The findings indicate that usability-related factors, particularly System Efficiency and Learning Burden, exert the greatest influence on the composite score under the specified weighting scheme, while other themes also contribute positively but more modestly. The study offers a transparent and privacy-preserving bridge between thematic synthesis and predictive probabilistic modeling, providing a reproducible framework for linking GenAI perceptions to educational outcomes in future research. |
| title | Quantifying Student Success with Generative AI: A Monte Carlo Simulation Informed by Systematic Review |
| topic | Computers and Society Artificial Intelligence 62P25, 65C05 K.3.1; H.5.2; I.2.7 |
| url | https://arxiv.org/abs/2507.01062 |