Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.07571 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913196874399744 |
|---|---|
| author | Wang, Guoxin Shi, Sheng An, Shan Fan, Fengmei Ge, Wenshu Wang, Qi Yu, Feng Wang, Zhiren |
| author_facet | Wang, Guoxin Shi, Sheng An, Shan Fan, Fengmei Ge, Wenshu Wang, Qi Yu, Feng Wang, Zhiren |
| contents | Previous research on the diagnosis of Bipolar disorder has mainly focused on resting-state functional magnetic resonance imaging. However, their accuracy can not meet the requirements of clinical diagnosis. Efficient multimodal fusion strategies have great potential for applications in multimodal data and can further improve the performance of medical diagnosis models. In this work, we utilize both sMRI and fMRI data and propose a novel multimodal diagnosis model for bipolar disorder. The proposed Patch Pyramid Feature Extraction Module extracts sMRI features, and the spatio-temporal pyramid structure extracts the fMRI features. Finally, they are fused by a fusion module to output diagnosis results with a classifier. Extensive experiments show that our proposed method outperforms others in balanced accuracy from 0.657 to 0.732 on the OpenfMRI dataset, and achieves the state of the art. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_07571 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders Wang, Guoxin Shi, Sheng An, Shan Fan, Fengmei Ge, Wenshu Wang, Qi Yu, Feng Wang, Zhiren Computer Vision and Pattern Recognition Previous research on the diagnosis of Bipolar disorder has mainly focused on resting-state functional magnetic resonance imaging. However, their accuracy can not meet the requirements of clinical diagnosis. Efficient multimodal fusion strategies have great potential for applications in multimodal data and can further improve the performance of medical diagnosis models. In this work, we utilize both sMRI and fMRI data and propose a novel multimodal diagnosis model for bipolar disorder. The proposed Patch Pyramid Feature Extraction Module extracts sMRI features, and the spatio-temporal pyramid structure extracts the fMRI features. Finally, they are fused by a fusion module to output diagnosis results with a classifier. Extensive experiments show that our proposed method outperforms others in balanced accuracy from 0.657 to 0.732 on the OpenfMRI dataset, and achieves the state of the art. |
| title | A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.07571 |