Sparks of Rationality: Do Reasoning LLMs Align with Human Judgment and Choice?
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918314406576128 |
|---|---|
| author | Tak, Ala N. Banayeeanzade, Amin Bolourani, Anahita Bahrani, Fatemeh Chaubey, Ashutosh Karimireddy, Sai Praneeth Schwarz, Norbert Gratch, Jonathan |
| author_facet | Tak, Ala N. Banayeeanzade, Amin Bolourani, Anahita Bahrani, Fatemeh Chaubey, Ashutosh Karimireddy, Sai Praneeth Schwarz, Norbert Gratch, Jonathan |
| contents | Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are to participate in high-stakes decisions or serve as models of human behavior, it is critical to assess whether they exhibit analogous patterns of (ir)rationalities and biases. To this end, we evaluate multiple LLM families on (i) benchmarks testing core axioms of rational choice and (ii) classic decision domains from behavioral economics and social norms where emotions are known to shape judgment and choice. Across settings, we show that deliberate "thinking" reliably improves rationality and pushes models toward expected-value maximization. To probe human-like affective distortions and their interaction with reasoning, we use two emotion-steering methods: in-context priming (ICP) and representation-level steering (RLS). ICP induces strong directional shifts that are often extreme and difficult to calibrate, whereas RLS produces more psychologically plausible patterns but with lower reliability. Our results suggest that the same mechanisms that improve rationality also amplify sensitivity to affective interventions, and that different steering methods trade off controllability against human-aligned behavior. Overall, this points to a tension between reasoning and affective steering, with implications for both human simulation and the safe deployment of LLM-based decision systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_22329 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Sparks of Rationality: Do Reasoning LLMs Align with Human Judgment and Choice? Tak, Ala N. Banayeeanzade, Amin Bolourani, Anahita Bahrani, Fatemeh Chaubey, Ashutosh Karimireddy, Sai Praneeth Schwarz, Norbert Gratch, Jonathan Artificial Intelligence Computers and Society Large Language Models (LLMs) are increasingly positioned as decision engines for hiring, healthcare, and economic judgment, yet real-world human judgment reflects a balance between rational deliberation and emotion-driven bias. If LLMs are to participate in high-stakes decisions or serve as models of human behavior, it is critical to assess whether they exhibit analogous patterns of (ir)rationalities and biases. To this end, we evaluate multiple LLM families on (i) benchmarks testing core axioms of rational choice and (ii) classic decision domains from behavioral economics and social norms where emotions are known to shape judgment and choice. Across settings, we show that deliberate "thinking" reliably improves rationality and pushes models toward expected-value maximization. To probe human-like affective distortions and their interaction with reasoning, we use two emotion-steering methods: in-context priming (ICP) and representation-level steering (RLS). ICP induces strong directional shifts that are often extreme and difficult to calibrate, whereas RLS produces more psychologically plausible patterns but with lower reliability. Our results suggest that the same mechanisms that improve rationality also amplify sensitivity to affective interventions, and that different steering methods trade off controllability against human-aligned behavior. Overall, this points to a tension between reasoning and affective steering, with implications for both human simulation and the safe deployment of LLM-based decision systems. |
| title | Sparks of Rationality: Do Reasoning LLMs Align with Human Judgment and Choice? |
| topic | Artificial Intelligence Computers and Society |
| url | https://arxiv.org/abs/2601.22329 |