Saved in:
Bibliographic Details
Main Authors: Luo, Junjie, Han, Rui, Welivita, Arshana, Di, Zeleikun, Wu, Jingfu, Zhi, Xuzhe, Agarwal, Ritu, Gao, Gordon
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.03997
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911192100896768
author Luo, Junjie
Han, Rui
Welivita, Arshana
Di, Zeleikun
Wu, Jingfu
Zhi, Xuzhe
Agarwal, Ritu
Gao, Gordon
author_facet Luo, Junjie
Han, Rui
Welivita, Arshana
Di, Zeleikun
Wu, Jingfu
Zhi, Xuzhe
Agarwal, Ritu
Gao, Gordon
contents Understanding how patients perceive their physicians is essential to improving trust, communication, and satisfaction. We present a large language model (LLM)-based pipeline that infers Big Five personality traits and five patient-oriented subjective judgments. The analysis encompasses 4.1 million patient reviews of 226,999 U.S. physicians from an initial pool of one million. We validate the method through multi-model comparison and human expert benchmarking, achieving strong agreement between human and LLM assessments (correlation coefficients 0.72-0.89) and external validity through correlations with patient satisfaction (r = 0.41-0.81, all p<0.001). National-scale analysis reveals systematic patterns: male physicians receive higher ratings across all traits, with largest disparities in clinical competence perceptions; empathy-related traits predominate in pediatrics and psychiatry; and all traits positively predict overall satisfaction. Cluster analysis identifies four distinct physician archetypes, from "Well-Rounded Excellent" (33.8%, uniformly high traits) to "Underperforming" (22.6%, consistently low). These findings demonstrate that automated trait extraction from patient narratives can provide interpretable, validated metrics for understanding physician-patient relationships at scale, with implications for quality measurement, bias detection, and workforce development in healthcare.
format Preprint
id arxiv_https___arxiv_org_abs_2510_03997
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Mapping Patient-Perceived Physician Traits from Nationwide Online Reviews with LLMs
Luo, Junjie
Han, Rui
Welivita, Arshana
Di, Zeleikun
Wu, Jingfu
Zhi, Xuzhe
Agarwal, Ritu
Gao, Gordon
Computation and Language
Understanding how patients perceive their physicians is essential to improving trust, communication, and satisfaction. We present a large language model (LLM)-based pipeline that infers Big Five personality traits and five patient-oriented subjective judgments. The analysis encompasses 4.1 million patient reviews of 226,999 U.S. physicians from an initial pool of one million. We validate the method through multi-model comparison and human expert benchmarking, achieving strong agreement between human and LLM assessments (correlation coefficients 0.72-0.89) and external validity through correlations with patient satisfaction (r = 0.41-0.81, all p<0.001). National-scale analysis reveals systematic patterns: male physicians receive higher ratings across all traits, with largest disparities in clinical competence perceptions; empathy-related traits predominate in pediatrics and psychiatry; and all traits positively predict overall satisfaction. Cluster analysis identifies four distinct physician archetypes, from "Well-Rounded Excellent" (33.8%, uniformly high traits) to "Underperforming" (22.6%, consistently low). These findings demonstrate that automated trait extraction from patient narratives can provide interpretable, validated metrics for understanding physician-patient relationships at scale, with implications for quality measurement, bias detection, and workforce development in healthcare.
title Mapping Patient-Perceived Physician Traits from Nationwide Online Reviews with LLMs
topic Computation and Language
url https://arxiv.org/abs/2510.03997