Large language models show fragile cognitive reasoning about human emotions

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bhattacharyya, Sree, Kuriabov, Evgenii, Craig, Lucas, Dilliraj, Tharun, Adams, Jr., Reginald B., Li, Jia, Wang, James Z.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918387215499264
author Bhattacharyya, Sree
Kuriabov, Evgenii
Craig, Lucas
Dilliraj, Tharun
Adams, Jr., Reginald B.
Li, Jia
Wang, James Z.
author_facet Bhattacharyya, Sree
Kuriabov, Evgenii
Craig, Lucas
Dilliraj, Tharun
Adams, Jr., Reginald B.
Li, Jia
Wang, James Z.
contents Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated on emotion-related tasks, typically using supervised learning with discrete emotion labels. Such evaluations largely focus on surface phenomena, such as recognizing expressed or evoked emotions, leaving open whether these systems reason about emotion in cognitively meaningful ways. Here we ask whether LLMs can reason about emotions through underlying cognitive dimensions rather than labels alone. Drawing on cognitive appraisal theory, we introduce CoRE, a large-scale benchmark designed to probe the implicit cognitive structures LLMs use when interpreting emotionally charged situations. We assess alignment with human appraisal patterns, internal consistency, cross-model generalization, and robustness to contextual variation. We find that LLMs capture systematic relations between cognitive appraisals and emotions but show misalignment with human judgments and instability across contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2508_05880
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large language models show fragile cognitive reasoning about human emotions
Bhattacharyya, Sree
Kuriabov, Evgenii
Craig, Lucas
Dilliraj, Tharun
Adams, Jr., Reginald B.
Li, Jia
Wang, James Z.
Computation and Language
Artificial Intelligence
Affective computing seeks to support the holistic development of artificial intelligence by enabling machines to engage with human emotion. Recent foundation models, particularly large language models (LLMs), have been trained and evaluated on emotion-related tasks, typically using supervised learning with discrete emotion labels. Such evaluations largely focus on surface phenomena, such as recognizing expressed or evoked emotions, leaving open whether these systems reason about emotion in cognitively meaningful ways. Here we ask whether LLMs can reason about emotions through underlying cognitive dimensions rather than labels alone. Drawing on cognitive appraisal theory, we introduce CoRE, a large-scale benchmark designed to probe the implicit cognitive structures LLMs use when interpreting emotionally charged situations. We assess alignment with human appraisal patterns, internal consistency, cross-model generalization, and robustness to contextual variation. We find that LLMs capture systematic relations between cognitive appraisals and emotions but show misalignment with human judgments and instability across contexts.
title Large language models show fragile cognitive reasoning about human emotions
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2508.05880