Who are you, ChatGPT? Personality and Demographic Style in LLM-Generated Content

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Porat, Dana Sotto, Rabinovich, Ella
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917008678846464
author Porat, Dana Sotto
Rabinovich, Ella
author_facet Porat, Dana Sotto
Rabinovich, Ella
contents Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like characteristics in their language. In this work, we introduce a novel, data-driven methodology for assessing LLM personality without relying on self-report questionnaires, applying instead automatic personality and gender classifiers to model replies on open-ended questions collected from Reddit. Comparing six widely used models to human-authored responses, we find that LLMs systematically express higher Agreeableness and lower Neuroticism, reflecting cooperative and stable conversational tendencies. Gendered language patterns in model text broadly resemble those of human writers, though with reduced variation, echoing prior findings on automated agents. We contribute a new dataset of human and model responses, along with large-scale comparative analyses, shedding new light on the topic of personality and demographic patterns of generative AI.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11434
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Who are you, ChatGPT? Personality and Demographic Style in LLM-Generated Content
Porat, Dana Sotto
Rabinovich, Ella
Computation and Language
Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like characteristics in their language. In this work, we introduce a novel, data-driven methodology for assessing LLM personality without relying on self-report questionnaires, applying instead automatic personality and gender classifiers to model replies on open-ended questions collected from Reddit. Comparing six widely used models to human-authored responses, we find that LLMs systematically express higher Agreeableness and lower Neuroticism, reflecting cooperative and stable conversational tendencies. Gendered language patterns in model text broadly resemble those of human writers, though with reduced variation, echoing prior findings on automated agents. We contribute a new dataset of human and model responses, along with large-scale comparative analyses, shedding new light on the topic of personality and demographic patterns of generative AI.
title Who are you, ChatGPT? Personality and Demographic Style in LLM-Generated Content
topic Computation and Language
url https://arxiv.org/abs/2510.11434