Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2509.20140 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909804725796864 |
|---|---|
| author | Li, Zongyi Zhao, Junchuan Lee, Francis Bu Sung Yee, Andrew Zi Han |
| author_facet | Li, Zongyi Zhao, Junchuan Lee, Francis Bu Sung Yee, Andrew Zi Han |
| contents | Detecting emotional inconsistency across modalities is a key challenge in affective computing, as speech and text often convey conflicting cues. Existing approaches generally rely on incomplete emotion representations and employ unconditional fusion, which weakens performance when modalities are inconsistent. Moreover, little prior work explicitly addresses inconsistency detection itself. We propose InconVAD, a two-stage framework grounded in the Valence/Arousal/Dominance (VAD) space. In the first stage, independent uncertainty-aware models yield robust unimodal predictions. In the second stage, a classifier identifies cross-modal inconsistency and selectively integrates consistent signals. Extensive experiments show that InconVAD surpasses existing methods in both multimodal emotion inconsistency detection and modeling, offering a more reliable and interpretable solution for emotion analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_20140 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | InconVAD: A Two-Stage Dual-Tower Framework for Multimodal Emotion Inconsistency Detection Li, Zongyi Zhao, Junchuan Lee, Francis Bu Sung Yee, Andrew Zi Han Multimedia Sound Detecting emotional inconsistency across modalities is a key challenge in affective computing, as speech and text often convey conflicting cues. Existing approaches generally rely on incomplete emotion representations and employ unconditional fusion, which weakens performance when modalities are inconsistent. Moreover, little prior work explicitly addresses inconsistency detection itself. We propose InconVAD, a two-stage framework grounded in the Valence/Arousal/Dominance (VAD) space. In the first stage, independent uncertainty-aware models yield robust unimodal predictions. In the second stage, a classifier identifies cross-modal inconsistency and selectively integrates consistent signals. Extensive experiments show that InconVAD surpasses existing methods in both multimodal emotion inconsistency detection and modeling, offering a more reliable and interpretable solution for emotion analysis. |
| title | InconVAD: A Two-Stage Dual-Tower Framework for Multimodal Emotion Inconsistency Detection |
| topic | Multimedia Sound |
| url | https://arxiv.org/abs/2509.20140 |