SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908933481824256 |
|---|---|
| author | Cai, Yiqiang Wu, Chengyan Ma, Bolei Chen, Bo Xue, Yun Hirschberg, Julia Gong, Ziwei |
| author_facet | Cai, Yiqiang Wu, Chengyan Ma, Bolei Chen, Bo Xue, Yun Hirschberg, Julia Gong, Ziwei |
| contents | Multimodal emotion recognition in conversations (MERC) requires integrating multimodal signals while being robust to noise and modeling contextual reasoning. Existing approaches often emphasize fusion but overlook uncertainty in noisy features and fine-grained reasoning. We propose SURE (Synergistic Uncertainty-aware REasoning) for MERC, a framework that improves robustness and contextual modeling. SURE consists of three components: an Uncertainty-Aware Mixture-of-Experts module to handle modality-specific noise, an Iterative Reasoning module for multi-turn reasoning over context, and a Transformer Gate module to capture intra- and inter-modal interactions. Experiments on benchmark MERC datasets show that SURE consistently outperforms state-of-the-art methods, demonstrating its effectiveness in robust multimodal reasoning. These results highlight the importance of uncertainty modeling and iterative reasoning in advancing emotion recognition in conversational settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_01916 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations Cai, Yiqiang Wu, Chengyan Ma, Bolei Chen, Bo Xue, Yun Hirschberg, Julia Gong, Ziwei Computation and Language Multimodal emotion recognition in conversations (MERC) requires integrating multimodal signals while being robust to noise and modeling contextual reasoning. Existing approaches often emphasize fusion but overlook uncertainty in noisy features and fine-grained reasoning. We propose SURE (Synergistic Uncertainty-aware REasoning) for MERC, a framework that improves robustness and contextual modeling. SURE consists of three components: an Uncertainty-Aware Mixture-of-Experts module to handle modality-specific noise, an Iterative Reasoning module for multi-turn reasoning over context, and a Transformer Gate module to capture intra- and inter-modal interactions. Experiments on benchmark MERC datasets show that SURE consistently outperforms state-of-the-art methods, demonstrating its effectiveness in robust multimodal reasoning. These results highlight the importance of uncertainty modeling and iterative reasoning in advancing emotion recognition in conversational settings. |
| title | SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.01916 |