Comparing LLM-generated and human-authored news text using formal syntactic theory

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zamaraeva, Olga, Flickinger, Dan, Bond, Francis, Gómez-Rodríguez, Carlos
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910980246601728
author Zamaraeva, Olga
Flickinger, Dan
Bond, Francis
Gómez-Rodríguez, Carlos
author_facet Zamaraeva, Olga
Flickinger, Dan
Bond, Francis
Gómez-Rodríguez, Carlos
contents This study provides the first comprehensive comparison of New York Times-style text generated by six large language models against real, human-authored NYT writing. The comparison is based on a formal syntactic theory. We use Head-driven Phrase Structure Grammar (HPSG) to analyze the grammatical structure of the texts. We then investigate and illustrate the differences in the distributions of HPSG grammar types, revealing systematic distinctions between human and LLM-generated writing. These findings contribute to a deeper understanding of the syntactic behavior of LLMs as well as humans, within the NYT genre.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01407
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Comparing LLM-generated and human-authored news text using formal syntactic theory
Zamaraeva, Olga
Flickinger, Dan
Bond, Francis
Gómez-Rodríguez, Carlos
Computation and Language
This study provides the first comprehensive comparison of New York Times-style text generated by six large language models against real, human-authored NYT writing. The comparison is based on a formal syntactic theory. We use Head-driven Phrase Structure Grammar (HPSG) to analyze the grammatical structure of the texts. We then investigate and illustrate the differences in the distributions of HPSG grammar types, revealing systematic distinctions between human and LLM-generated writing. These findings contribute to a deeper understanding of the syntactic behavior of LLMs as well as humans, within the NYT genre.
title Comparing LLM-generated and human-authored news text using formal syntactic theory
topic Computation and Language
url https://arxiv.org/abs/2506.01407