Saved in:
Bibliographic Details
Main Authors: Zhu, Jianfeng, Jin, Ruoming, Coifman, Karin G.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.14355
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911066126024704
author Zhu, Jianfeng
Jin, Ruoming
Coifman, Karin G.
author_facet Zhu, Jianfeng
Jin, Ruoming
Coifman, Karin G.
contents Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often relied on synthetic data or social media text lacking psychometric validity. We introduce a real-world benchmark of 555 semi-structured interviews with BFI-10 self-report scores for evaluating LLM-based personality inference. Three state-of-the-art LLMs (GPT-4.1 Mini, Meta-LLaMA, and DeepSeek) were tested using zero-shot prompting for BFI-10 item prediction and both zero-shot and chain-of-thought prompting for Big Five trait inference. All models showed high test-retest reliability, but construct validity was limited: correlations with ground-truth scores were weak (max Pearson's $r = 0.27$), interrater agreement was low (Cohen's $κ< 0.10$), and predictions were biased toward moderate or high trait levels. Chain-of-thought prompting and longer input context modestly improved distributional alignment, but not trait-level accuracy. These results underscore limitations in current LLM-based personality inference and highlight the need for evidence-based development for psychological applications.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14355
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Can LLMs Infer Personality from Real World Conversations?
Zhu, Jianfeng
Jin, Ruoming
Coifman, Karin G.
Computation and Language
Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often relied on synthetic data or social media text lacking psychometric validity. We introduce a real-world benchmark of 555 semi-structured interviews with BFI-10 self-report scores for evaluating LLM-based personality inference. Three state-of-the-art LLMs (GPT-4.1 Mini, Meta-LLaMA, and DeepSeek) were tested using zero-shot prompting for BFI-10 item prediction and both zero-shot and chain-of-thought prompting for Big Five trait inference. All models showed high test-retest reliability, but construct validity was limited: correlations with ground-truth scores were weak (max Pearson's $r = 0.27$), interrater agreement was low (Cohen's $κ< 0.10$), and predictions were biased toward moderate or high trait levels. Chain-of-thought prompting and longer input context modestly improved distributional alignment, but not trait-level accuracy. These results underscore limitations in current LLM-based personality inference and highlight the need for evidence-based development for psychological applications.
title Can LLMs Infer Personality from Real World Conversations?
topic Computation and Language
url https://arxiv.org/abs/2507.14355