In-Depth Analysis of Emotion Recognition through Knowledge-Based Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916343958208512 |
|---|---|
| author | Han, Bin Yau, Cleo Lei, Su Gratch, Jonathan |
| author_facet | Han, Bin Yau, Cleo Lei, Su Gratch, Jonathan |
| contents | Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on decontextualized signals, recent research emphasizes the importance of context in shaping emotion perceptions. This paper contributes to the emerging field of context-based emotion recognition by leveraging psychological theories of human emotion perception to inform the design of automated methods. We propose an approach that combines emotion recognition methods with Bayesian Cue Integration (BCI) to integrate emotion inferences from decontextualized facial expressions and contextual knowledge inferred via Large-language Models. We test this approach in the context of interpreting facial expressions during a social task, the prisoner's dilemma. Our results provide clear support for BCI across a range of automatic emotion recognition methods. The best automated method achieved results comparable to human observers, suggesting the potential for this approach to advance the field of affective computing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_00780 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | In-Depth Analysis of Emotion Recognition through Knowledge-Based Large Language Models Han, Bin Yau, Cleo Lei, Su Gratch, Jonathan Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition 68 Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on decontextualized signals, recent research emphasizes the importance of context in shaping emotion perceptions. This paper contributes to the emerging field of context-based emotion recognition by leveraging psychological theories of human emotion perception to inform the design of automated methods. We propose an approach that combines emotion recognition methods with Bayesian Cue Integration (BCI) to integrate emotion inferences from decontextualized facial expressions and contextual knowledge inferred via Large-language Models. We test this approach in the context of interpreting facial expressions during a social task, the prisoner's dilemma. Our results provide clear support for BCI across a range of automatic emotion recognition methods. The best automated method achieved results comparable to human observers, suggesting the potential for this approach to advance the field of affective computing. |
| title | In-Depth Analysis of Emotion Recognition through Knowledge-Based Large Language Models |
| topic | Human-Computer Interaction Artificial Intelligence Computer Vision and Pattern Recognition 68 |
| url | https://arxiv.org/abs/2408.00780 |