Small Lesions-aware Bidirectional Multimodal Multiscale Fusion Network for Lung Disease Classification
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911093952086016 |
|---|---|
| author | Yu, Jianxun Ge, Ruiquan Wang, Zhipeng Yang, Cheng Lin, Chenyu Fu, Xianjun Liu, Jikui Elazab, Ahmed Wang, Changmiao |
| author_facet | Yu, Jianxun Ge, Ruiquan Wang, Zhipeng Yang, Cheng Lin, Chenyu Fu, Xianjun Liu, Jikui Elazab, Ahmed Wang, Changmiao |
| contents | The diagnosis of medical diseases faces challenges such as the misdiagnosis of small lesions. Deep learning, particularly multimodal approaches, has shown great potential in the field of medical disease diagnosis. However, the differences in dimensionality between medical imaging and electronic health record data present challenges for effective alignment and fusion. To address these issues, we propose the Multimodal Multiscale Cross-Attention Fusion Network (MMCAF-Net). This model employs a feature pyramid structure combined with an efficient 3D multi-scale convolutional attention module to extract lesion-specific features from 3D medical images. To further enhance multimodal data integration, MMCAF-Net incorporates a multi-scale cross-attention module, which resolves dimensional inconsistencies, enabling more effective feature fusion. We evaluated MMCAF-Net on the Lung-PET-CT-Dx dataset, and the results showed a significant improvement in diagnostic accuracy, surpassing current state-of-the-art methods. The code is available at https://github.com/yjx1234/MMCAF-Net |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_04205 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Small Lesions-aware Bidirectional Multimodal Multiscale Fusion Network for Lung Disease Classification Yu, Jianxun Ge, Ruiquan Wang, Zhipeng Yang, Cheng Lin, Chenyu Fu, Xianjun Liu, Jikui Elazab, Ahmed Wang, Changmiao Computer Vision and Pattern Recognition The diagnosis of medical diseases faces challenges such as the misdiagnosis of small lesions. Deep learning, particularly multimodal approaches, has shown great potential in the field of medical disease diagnosis. However, the differences in dimensionality between medical imaging and electronic health record data present challenges for effective alignment and fusion. To address these issues, we propose the Multimodal Multiscale Cross-Attention Fusion Network (MMCAF-Net). This model employs a feature pyramid structure combined with an efficient 3D multi-scale convolutional attention module to extract lesion-specific features from 3D medical images. To further enhance multimodal data integration, MMCAF-Net incorporates a multi-scale cross-attention module, which resolves dimensional inconsistencies, enabling more effective feature fusion. We evaluated MMCAF-Net on the Lung-PET-CT-Dx dataset, and the results showed a significant improvement in diagnostic accuracy, surpassing current state-of-the-art methods. The code is available at https://github.com/yjx1234/MMCAF-Net |
| title | Small Lesions-aware Bidirectional Multimodal Multiscale Fusion Network for Lung Disease Classification |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2508.04205 |