Buchumschlag

Sociodemographic Prompting is Not Yet an Effective Approach for Simulating Subjective Judgments with LLMs

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Sun, Huaman, Pei, Jiaxin, Choi, Minje, Jurgens, David
Format:	Preprint
Veröffentlicht:	2023
Schlagworte:	Computation and Language Artificial Intelligence Computers and Society Human-Computer Interaction Machine Learning
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Modeling Public Perceptions of Science in Media
von: Pei, Jiaxin, et al.
Veröffentlicht: (2025)

When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models
von: Zheng, Mingqian, et al.
Veröffentlicht: (2023)

Between Rules and Reality: On the Context Sensitivity of LLM Moral Judgment
von: Sauter, Adrian, et al.
Veröffentlicht: (2026)

The Automated but Risky Game: Modeling and Benchmarking Agent-to-Agent Negotiations and Transactions in Consumer Markets
von: Zhu, Shenzhe, et al.
Veröffentlicht: (2025)

Effectiveness of Large Language Models in Simulating Regional Psychological Structures: An Empirical Examination of Personality and Subjective Well-being
von: Luoma, Ke, et al.
Veröffentlicht: (2025)

Cognitive Bias Detection Using Advanced Prompt Engineering
von: Lemieux, Frederic, et al.
Veröffentlicht: (2025)

Effective Yet Ephemeral Propaganda Defense: There Needs to Be More than One-Shot Inoculation to Enhance Critical Thinking
von: Hoferer, Nicolas, et al.
Veröffentlicht: (2025)

Hidden Prompts in Manuscripts Exploit AI-Assisted Peer Review
von: Lin, Zhicheng
Veröffentlicht: (2025)

Toxic HallucinAItions: Perturbing Prompts and Tracing LLM Circuits
von: Shimgekar, Soorya Ram, et al.
Veröffentlicht: (2026)

On the Reliability of Large Language Models to Misinformed and Demographically-Informed Prompts
von: Aremu, Toluwani, et al.
Veröffentlicht: (2024)

Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforce
von: Shao, Yijia, et al.
Veröffentlicht: (2025)

From Prompts to Constructs: A Dual-Validity Framework for LLM Research in Psychology
von: Lin, Zhicheng
Veröffentlicht: (2025)

How Do AI Agents Spend Your Money? Analyzing and Predicting Token Consumption in Agentic Coding Tasks
von: Bai, Longju, et al.
Veröffentlicht: (2026)

LLM Social Simulations Are a Promising Research Method
von: Anthis, Jacy Reese, et al.
Veröffentlicht: (2025)

The Reliability of LLMs for Medical Diagnosis: An Examination of Consistency, Manipulation, and Contextual Awareness
von: Subedi, Krishna
Veröffentlicht: (2025)

A Comprehensive Survey of Bias in LLMs: Current Landscape and Future Directions
von: Ranjan, Rajesh, et al.
Veröffentlicht: (2024)

Large Language Models as Psychological Simulators: A Methodological Guide
von: Lin, Zhicheng
Veröffentlicht: (2025)

Prompt Engineering Techniques for Mitigating Cultural Bias Against Arabs and Muslims in Large Language Models: A Systematic Review
von: Asseri, Bushra, et al.
Veröffentlicht: (2025)

Plurals: A System for Guiding LLMs Via Simulated Social Ensembles
von: Ashkinaze, Joshua, et al.
Veröffentlicht: (2024)

Evaluating LLM Adaptation to Sociodemographic Factors: User Profile vs. Dialogue History
von: Zhong, Qishuai, et al.
Veröffentlicht: (2025)

Seeing Like an AI: How LLMs Apply (and Misapply) Wikipedia Neutrality Norms
von: Ashkinaze, Joshua, et al.
Veröffentlicht: (2024)

Who's Asking? Simulating Role-Based Questions for Conversational AI Evaluation
von: Kaur, Navreet, et al.
Veröffentlicht: (2025)

The Imperfect Learner: Incorporating Developmental Trajectories in Memory-based Student Simulation
von: Liu, Zhengyuan, et al.
Veröffentlicht: (2025)

Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation
von: Garcia, Adriana Alvarado, et al.
Veröffentlicht: (2026)

From "Help" to Helpful: A Hierarchical Assessment of LLMs in Mental e-Health Applications
von: Steigerwald, Philipp, et al.
Veröffentlicht: (2026)

How Persuasive Could LLMs Be? A First Study Combining Linguistic-Rhetorical Analysis and User Experiments
von: Raffini, Daniel, et al.
Veröffentlicht: (2025)

Understanding the LLM-ification of CHI: Unpacking the Impact of LLMs at CHI through a Systematic Literature Review
von: Pang, Rock Yuren, et al.
Veröffentlicht: (2025)

Neutral Prompts, Non-Neutral People: Quantifying Gender and Skin-Tone Bias in Gemini Flash 2.5 Image and GPT Image 1.5
von: Balestri, Roberto
Veröffentlicht: (2026)

What Do LLMs Associate with Your Name? A Human-Centered Black-Box Audit of Personal Data
von: Staufer, Dimitri, et al.
Veröffentlicht: (2026)

Imperfectly Cooperative Human-AI Interactions: Comparing the Impacts of Human and AI Attributes in Simulated and User Studies
von: Cohen, Myke C., et al.
Veröffentlicht: (2026)

SPRIG: Improving Large Language Model Performance by System Prompt Optimization
von: Zhang, Lechen, et al.
Veröffentlicht: (2024)

STAR: SocioTechnical Approach to Red Teaming Language Models
von: Weidinger, Laura, et al.
Veröffentlicht: (2024)

Patterns vs. Patients: Evaluating LLMs against Mental Health Professionals on Personality Disorder Diagnosis through First-Person Narratives
von: Drożdż, Karolina, et al.
Veröffentlicht: (2025)

A Close Reading Approach to Gender Narrative Biases in AI-Generated Stories
von: Raffini, Daniel, et al.
Veröffentlicht: (2025)

Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Dialogue
von: Ivey, Jonathan, et al.
Veröffentlicht: (2024)

PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support
von: Kim, Jiwon, et al.
Veröffentlicht: (2026)

Literary Narrative as Moral Probe : A Cross-System Framework for Evaluating AI Ethical Reasoning and Refusal Behavior
von: Flynn, David C.
Veröffentlicht: (2026)

AI-washing: The Asymmetric Effects of Its Two Types on Consumer Moral Judgments
von: Nyilasy, Greg, et al.
Veröffentlicht: (2025)

The Alignment Target Problem: Divergent Moral Judgments of Humans, AI Systems, and Their Designers
von: Chen, Benjamin Minhao, et al.
Veröffentlicht: (2026)

Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languages
von: Zhang, Lechen, et al.
Veröffentlicht: (2025)