SemIRNet: A Semantic Irony Recognition Network for Multimodal Sarcasm Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912436851834880 |
|---|---|
| author | Zhou, Jingxuan Wu, Yuehao Zhang, Yibo Zhang, Yeyubei Liu, Yunchong Huang, Bolin Yuan, Chunhong |
| author_facet | Zhou, Jingxuan Wu, Yuehao Zhang, Yibo Zhang, Yeyubei Liu, Yunchong Huang, Bolin Yuan, Chunhong |
| contents | Aiming at the problem of difficulty in accurately identifying graphical implicit correlations in multimodal irony detection tasks, this paper proposes a Semantic Irony Recognition Network (SemIRNet). The model contains three main innovations: (1) The ConceptNet knowledge base is introduced for the first time to acquire conceptual knowledge, which enhances the model's common-sense reasoning ability; (2) Two cross-modal semantic similarity detection modules at the word level and sample level are designed to model graphic-textual correlations at different granularities; and (3) A contrastive learning loss function is introduced to optimize the spatial distribution of the sample features, which improves the separability of positive and negative samples. Experiments on a publicly available multimodal irony detection benchmark dataset show that the accuracy and F1 value of this model are improved by 1.64% and 2.88% to 88.87% and 86.33%, respectively, compared with the existing optimal methods. Further ablation experiments verify the important role of knowledge fusion and semantic similarity detection in improving the model performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_14791 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SemIRNet: A Semantic Irony Recognition Network for Multimodal Sarcasm Detection Zhou, Jingxuan Wu, Yuehao Zhang, Yibo Zhang, Yeyubei Liu, Yunchong Huang, Bolin Yuan, Chunhong Computer Vision and Pattern Recognition Computation and Language Machine Learning Aiming at the problem of difficulty in accurately identifying graphical implicit correlations in multimodal irony detection tasks, this paper proposes a Semantic Irony Recognition Network (SemIRNet). The model contains three main innovations: (1) The ConceptNet knowledge base is introduced for the first time to acquire conceptual knowledge, which enhances the model's common-sense reasoning ability; (2) Two cross-modal semantic similarity detection modules at the word level and sample level are designed to model graphic-textual correlations at different granularities; and (3) A contrastive learning loss function is introduced to optimize the spatial distribution of the sample features, which improves the separability of positive and negative samples. Experiments on a publicly available multimodal irony detection benchmark dataset show that the accuracy and F1 value of this model are improved by 1.64% and 2.88% to 88.87% and 86.33%, respectively, compared with the existing optimal methods. Further ablation experiments verify the important role of knowledge fusion and semantic similarity detection in improving the model performance. |
| title | SemIRNet: A Semantic Irony Recognition Network for Multimodal Sarcasm Detection |
| topic | Computer Vision and Pattern Recognition Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2506.14791 |