Beyond checkmate: exploring the creative chokepoints in AI text

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tripto, Nafis Irtiza, Venkatraman, Saranya, Nahar, Mahjabin, Lee, Dongwon
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912614005604352
author Tripto, Nafis Irtiza
Venkatraman, Saranya
Nahar, Mahjabin
Lee, Dongwon
author_facet Tripto, Nafis Irtiza
Venkatraman, Saranya
Nahar, Mahjabin
Lee, Dongwon
contents The rapid advancement of Large Language Models (LLMs) has revolutionized text generation but also raised concerns about potential misuse, making detecting LLM-generated text (AI text) increasingly essential. While prior work has focused on identifying AI text and effectively checkmating it, our study investigates a less-explored territory: portraying the nuanced distinctions between human and AI texts across text segments (introduction, body, and conclusion). Whether LLMs excel or falter in incorporating linguistic ingenuity across text segments, the results will critically inform their viability and boundaries as effective creative assistants to humans. Through an analogy with the structure of chess games, comprising opening, middle, and end games, we analyze segment-specific patterns to reveal where the most striking differences lie. Although AI texts closely resemble human writing in the body segment due to its length, deeper analysis shows a higher divergence in features dependent on the continuous flow of language, making it the most informative segment for detection. Additionally, human texts exhibit greater stylistic variation across segments, offering a new lens for distinguishing them from AI. Overall, our findings provide fresh insights into human-AI text differences and pave the way for more effective and interpretable detection strategies. Codes available at https://github.com/tripto03/chess_inspired_human_ai_text_distinction.
format Preprint
id arxiv_https___arxiv_org_abs_2501_19301
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Beyond checkmate: exploring the creative chokepoints in AI text
Tripto, Nafis Irtiza
Venkatraman, Saranya
Nahar, Mahjabin
Lee, Dongwon
Computation and Language
Artificial Intelligence
The rapid advancement of Large Language Models (LLMs) has revolutionized text generation but also raised concerns about potential misuse, making detecting LLM-generated text (AI text) increasingly essential. While prior work has focused on identifying AI text and effectively checkmating it, our study investigates a less-explored territory: portraying the nuanced distinctions between human and AI texts across text segments (introduction, body, and conclusion). Whether LLMs excel or falter in incorporating linguistic ingenuity across text segments, the results will critically inform their viability and boundaries as effective creative assistants to humans. Through an analogy with the structure of chess games, comprising opening, middle, and end games, we analyze segment-specific patterns to reveal where the most striking differences lie. Although AI texts closely resemble human writing in the body segment due to its length, deeper analysis shows a higher divergence in features dependent on the continuous flow of language, making it the most informative segment for detection. Additionally, human texts exhibit greater stylistic variation across segments, offering a new lens for distinguishing them from AI. Overall, our findings provide fresh insights into human-AI text differences and pave the way for more effective and interpretable detection strategies. Codes available at https://github.com/tripto03/chess_inspired_human_ai_text_distinction.
title Beyond checkmate: exploring the creative chokepoints in AI text
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2501.19301