Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.03650 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913004954583040 |
|---|---|
| author | Jiao, Minghai Xiao, Jing Xiao, Peng Zhang, Ende Kan, Shuang Jiang, Wenyan Li, Jinyao Liu, Yixian Xin, Haidong |
| author_facet | Jiao, Minghai Xiao, Jing Xiao, Peng Zhang, Ende Kan, Shuang Jiang, Wenyan Li, Jinyao Liu, Yixian Xin, Haidong |
| contents | Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transformer-based cross-modal attention, which incurs quadratic complexity with respect to sequence length and limits scalability. Moreover, contextual information from preceding utterances is often incorporated through concatenation or independent fusion, without explicit temporal modeling that captures sentiment evolution across dialogue turns. To address these limitations, we propose CAGMamba, a context-aware gated cross-modal Mamba framework for dialogue-based sentiment analysis. Specifically, we organize the contextual and the current-utterance features into a temporally ordered binary sequence, which provides Mamba with explicit temporal structure for modeling sentiment evolution. To further enable controllable cross-modal integration, we propose a Gated Cross-Modal Mamba Network (GCMN) that integrates cross-modal and unimodal paths via learnable gating to balance information fusion and modality preservation, and is trained with a three-branch multi-task objective over text, audio, and fused predictions. Experiments on three benchmark datasets demonstrate that CAGMamba achieves state-of-the-art or competitive results across multiple evaluation metrics. All codes are available at https://github.com/User2024-xj/CAGMamba. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_03650 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CAGMamba: Context-Aware Gated Cross-Modal Mamba Network for Multimodal Sentiment Analysis Jiao, Minghai Xiao, Jing Xiao, Peng Zhang, Ende Kan, Shuang Jiang, Wenyan Li, Jinyao Liu, Yixian Xin, Haidong Computation and Language Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transformer-based cross-modal attention, which incurs quadratic complexity with respect to sequence length and limits scalability. Moreover, contextual information from preceding utterances is often incorporated through concatenation or independent fusion, without explicit temporal modeling that captures sentiment evolution across dialogue turns. To address these limitations, we propose CAGMamba, a context-aware gated cross-modal Mamba framework for dialogue-based sentiment analysis. Specifically, we organize the contextual and the current-utterance features into a temporally ordered binary sequence, which provides Mamba with explicit temporal structure for modeling sentiment evolution. To further enable controllable cross-modal integration, we propose a Gated Cross-Modal Mamba Network (GCMN) that integrates cross-modal and unimodal paths via learnable gating to balance information fusion and modality preservation, and is trained with a three-branch multi-task objective over text, audio, and fused predictions. Experiments on three benchmark datasets demonstrate that CAGMamba achieves state-of-the-art or competitive results across multiple evaluation metrics. All codes are available at https://github.com/User2024-xj/CAGMamba. |
| title | CAGMamba: Context-Aware Gated Cross-Modal Mamba Network for Multimodal Sentiment Analysis |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.03650 |