StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Opara, Chidimma
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916249403916288
author Opara, Chidimma
author_facet Opara, Chidimma
contents The emergence of large language models (LLMs) capable of generating realistic texts and images has sparked ethical concerns across various sectors. In response, researchers in academia and industry are actively exploring methods to distinguish AI-generated content from human-authored material. However, a crucial question remains: What are the unique characteristics of AI-generated text? Addressing this gap, this study proposes StyloAI, a data-driven model that uses 31 stylometric features to identify AI-generated texts by applying a Random Forest classifier on two multi-domain datasets. StyloAI achieves accuracy rates of 81% and 98% on the test set of the AuTextification dataset and the Education dataset, respectively. This approach surpasses the performance of existing state-of-the-art models and provides valuable insights into the differences between AI-generated and human-authored texts.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10129
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis
Opara, Chidimma
Computation and Language
Artificial Intelligence
I.2.7
The emergence of large language models (LLMs) capable of generating realistic texts and images has sparked ethical concerns across various sectors. In response, researchers in academia and industry are actively exploring methods to distinguish AI-generated content from human-authored material. However, a crucial question remains: What are the unique characteristics of AI-generated text? Addressing this gap, this study proposes StyloAI, a data-driven model that uses 31 stylometric features to identify AI-generated texts by applying a Random Forest classifier on two multi-domain datasets. StyloAI achieves accuracy rates of 81% and 98% on the test set of the AuTextification dataset and the Education dataset, respectively. This approach surpasses the performance of existing state-of-the-art models and provides valuable insights into the differences between AI-generated and human-authored texts.
title StyloAI: Distinguishing AI-Generated Content with Stylometric Analysis
topic Computation and Language
Artificial Intelligence
I.2.7
url https://arxiv.org/abs/2405.10129