Human-like Affective Cognition in Foundation Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915800479170560 |
|---|---|
| author | Gandhi, Kanishk Lynch, Zoe Fränken, Jan-Philipp Patterson, Kayla Wambu, Sharon Gerstenberg, Tobias Ong, Desmond C. Goodman, Noah D. |
| author_facet | Gandhi, Kanishk Lynch, Zoe Fränken, Jan-Philipp Patterson, Kayla Wambu, Sharon Gerstenberg, Tobias Ong, Desmond C. Goodman, Noah D. |
| contents | Understanding emotions is fundamental to human interaction and experience. Humans easily infer emotions from situations or facial expressions, situations from emotions, and do a variety of other affective cognition. How adept is modern AI at these inferences? We introduce an evaluation framework for testing affective cognition in foundation models. Starting from psychological theory, we generate 1,280 diverse scenarios exploring relationships between appraisals, emotions, expressions, and outcomes. We evaluate the abilities of foundation models (GPT-4, Claude-3, Gemini-1.5-Pro) and humans (N = 567) across carefully selected conditions. Our results show foundation models tend to agree with human intuitions, matching or exceeding interparticipant agreement. In some conditions, models are ``superhuman'' -- they better predict modal human judgements than the average human. All models benefit from chain-of-thought reasoning. This suggests foundation models have acquired a human-like understanding of emotions and their influence on beliefs and behavior. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_11733 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Human-like Affective Cognition in Foundation Models Gandhi, Kanishk Lynch, Zoe Fränken, Jan-Philipp Patterson, Kayla Wambu, Sharon Gerstenberg, Tobias Ong, Desmond C. Goodman, Noah D. Computation and Language Understanding emotions is fundamental to human interaction and experience. Humans easily infer emotions from situations or facial expressions, situations from emotions, and do a variety of other affective cognition. How adept is modern AI at these inferences? We introduce an evaluation framework for testing affective cognition in foundation models. Starting from psychological theory, we generate 1,280 diverse scenarios exploring relationships between appraisals, emotions, expressions, and outcomes. We evaluate the abilities of foundation models (GPT-4, Claude-3, Gemini-1.5-Pro) and humans (N = 567) across carefully selected conditions. Our results show foundation models tend to agree with human intuitions, matching or exceeding interparticipant agreement. In some conditions, models are ``superhuman'' -- they better predict modal human judgements than the average human. All models benefit from chain-of-thought reasoning. This suggests foundation models have acquired a human-like understanding of emotions and their influence on beliefs and behavior. |
| title | Human-like Affective Cognition in Foundation Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2409.11733 |