Saved in:
Bibliographic Details
Main Authors: Kim, Jiseon, Kwon, Jea, Vecchietti, Luiz Felipe, Dong, Wenchao, Kim, Jaehong, Cha, Meeyoung
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.21871
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910160656531456
author Kim, Jiseon
Kwon, Jea
Vecchietti, Luiz Felipe
Dong, Wenchao
Kim, Jaehong
Cha, Meeyoung
author_facet Kim, Jiseon
Kwon, Jea
Vecchietti, Luiz Felipe
Dong, Wenchao
Kim, Jaehong
Cha, Meeyoung
contents Human moral judgment is context-dependent and modulated by interpersonal relationships. As large language models (LLMs) increasingly function as decision-support systems, determining whether they encode these social nuances is critical. We characterize machine behavior using the Whistleblower's Dilemma by varying two experimental dimensions: crime severity and relational closeness. Our study evaluates three distinct perspectives: (1) moral rightness (prescriptive norms), (2) predicted human behavior (descriptive social expectations), and (3) autonomous model decision-making. By analyzing the reasoning processes, we identify a clear cross-perspective divergence: while moral rightness remains consistently fairness-oriented, predicted human behavior shifts significantly toward loyalty as relational closeness increases. Crucially, model decisions align with moral rightness judgments rather than their own behavioral predictions. This inconsistency suggests that LLM decision-making prioritizes rigid, prescriptive rules over the social sensitivity present in their internal world-modeling, which poses a gap that may lead to significant misalignments in real-world deployments.
format Preprint
id arxiv_https___arxiv_org_abs_2604_21871
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model Decisions
Kim, Jiseon
Kwon, Jea
Vecchietti, Luiz Felipe
Dong, Wenchao
Kim, Jaehong
Cha, Meeyoung
Computation and Language
Human moral judgment is context-dependent and modulated by interpersonal relationships. As large language models (LLMs) increasingly function as decision-support systems, determining whether they encode these social nuances is critical. We characterize machine behavior using the Whistleblower's Dilemma by varying two experimental dimensions: crime severity and relational closeness. Our study evaluates three distinct perspectives: (1) moral rightness (prescriptive norms), (2) predicted human behavior (descriptive social expectations), and (3) autonomous model decision-making. By analyzing the reasoning processes, we identify a clear cross-perspective divergence: while moral rightness remains consistently fairness-oriented, predicted human behavior shifts significantly toward loyalty as relational closeness increases. Crucially, model decisions align with moral rightness judgments rather than their own behavioral predictions. This inconsistency suggests that LLM decision-making prioritizes rigid, prescriptive rules over the social sensitivity present in their internal world-modeling, which poses a gap that may lead to significant misalignments in real-world deployments.
title Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model Decisions
topic Computation and Language
url https://arxiv.org/abs/2604.21871