Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.23365 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912402296012800 |
|---|---|
| author | Qiao, Yang Zhong, Xiaoyu Gu, Xiaofeng Yu, Zhiguo |
| author_facet | Qiao, Yang Zhong, Xiaoyu Gu, Xiaofeng Yu, Zhiguo |
| contents | Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from effectively capturing fine-grained semantic interactions, thereby limiting their applicability in high-precision classification tasks. To address this issue, we propose a novel Multimodal Collaborative Fusion Network (MCFNet) designed for fine-grained classification. The proposed MCFNet architecture incorporates a regularized integrated fusion module that improves intra-modal feature representation through modality-specific regularization strategies, while facilitating precise semantic alignment via a hybrid attention mechanism. Additionally, we introduce a multimodal decision classification module, which jointly exploits inter-modal correlations and unimodal discriminative features by integrating multiple loss functions within a weighted voting paradigm. Extensive experiments and ablation studies on benchmark datasets demonstrate that the proposed MCFNet framework achieves consistent improvements in classification accuracy, confirming its effectiveness in modeling subtle cross-modal semantics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_23365 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MCFNet: A Multimodal Collaborative Fusion Network for Fine-Grained Semantic Classification Qiao, Yang Zhong, Xiaoyu Gu, Xiaofeng Yu, Zhiguo Computer Vision and Pattern Recognition Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from effectively capturing fine-grained semantic interactions, thereby limiting their applicability in high-precision classification tasks. To address this issue, we propose a novel Multimodal Collaborative Fusion Network (MCFNet) designed for fine-grained classification. The proposed MCFNet architecture incorporates a regularized integrated fusion module that improves intra-modal feature representation through modality-specific regularization strategies, while facilitating precise semantic alignment via a hybrid attention mechanism. Additionally, we introduce a multimodal decision classification module, which jointly exploits inter-modal correlations and unimodal discriminative features by integrating multiple loss functions within a weighted voting paradigm. Extensive experiments and ablation studies on benchmark datasets demonstrate that the proposed MCFNet framework achieves consistent improvements in classification accuracy, confirming its effectiveness in modeling subtle cross-modal semantics. |
| title | MCFNet: A Multimodal Collaborative Fusion Network for Fine-Grained Semantic Classification |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.23365 |