Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.03521 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914412647940096 |
|---|---|
| author | Lyu, Xiaosen Xiong, Jiayu Chen, Yuren Wang, Wanlong Dai, Xiaoqing Wang, Jing |
| author_facet | Lyu, Xiaosen Xiong, Jiayu Chen, Yuren Wang, Wanlong Dai, Xiaoqing Wang, Jing |
| contents | Multimodal Emotion Recognition in Conversation (MERC) aims to predict speakers' emotions by integrating textual, acoustic, and visual cues. Existing approaches either struggle to capture complex cross-modal interactions or experience gradient conflicts and unstable training when using deeper architectures. To address these issues, we propose Cross-Space Synergy (CSS), which couples a representation component with an optimization component. Synergistic Polynomial Fusion (SPF) serves the representation role, leveraging low-rank tensor factorization to efficiently capture high-order cross-modal interactions. Pareto Gradient Modulator (PGM) serves the optimization role, steering updates along Pareto-optimal directions across competing objectives to alleviate gradient conflicts and improve stability. Experiments show that CSS outperforms existing representative methods on IEMOCAP and MELD in both accuracy and training stability, demonstrating its effectiveness in complex multimodal scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_03521 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Cross-Space Synergy: A Unified Framework for Multimodal Emotion Recognition in Conversation Lyu, Xiaosen Xiong, Jiayu Chen, Yuren Wang, Wanlong Dai, Xiaoqing Wang, Jing Multimedia Machine Learning Multimodal Emotion Recognition in Conversation (MERC) aims to predict speakers' emotions by integrating textual, acoustic, and visual cues. Existing approaches either struggle to capture complex cross-modal interactions or experience gradient conflicts and unstable training when using deeper architectures. To address these issues, we propose Cross-Space Synergy (CSS), which couples a representation component with an optimization component. Synergistic Polynomial Fusion (SPF) serves the representation role, leveraging low-rank tensor factorization to efficiently capture high-order cross-modal interactions. Pareto Gradient Modulator (PGM) serves the optimization role, steering updates along Pareto-optimal directions across competing objectives to alleviate gradient conflicts and improve stability. Experiments show that CSS outperforms existing representative methods on IEMOCAP and MELD in both accuracy and training stability, demonstrating its effectiveness in complex multimodal scenarios. |
| title | Cross-Space Synergy: A Unified Framework for Multimodal Emotion Recognition in Conversation |
| topic | Multimedia Machine Learning |
| url | https://arxiv.org/abs/2512.03521 |