Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912339283935232 |
|---|---|
| author | Lo, Yui Chen, Yuqian Liu, Dongnan Liu, Wan Zekelman, Leo Zhang, Fan Rathi, Yogesh Makris, Nikos Golby, Alexandra J. Cai, Weidong O'Donnell, Lauren J. |
| author_facet | Lo, Yui Chen, Yuqian Liu, Dongnan Liu, Wan Zekelman, Leo Zhang, Fan Rathi, Yogesh Makris, Nikos Golby, Alexandra J. Cai, Weidong O'Donnell, Lauren J. |
| contents | Shape plays an important role in computer graphics, offering informative features to convey an object's morphology and functionality. Shape analysis in brain imaging can help interpret structural and functionality correlations of the human brain. In this work, we investigate the shape of the brain's 3D white matter connections and its potential predictive relationship to human cognitive function. We reconstruct brain connections as sequences of 3D points using diffusion magnetic resonance imaging (dMRI) tractography. To describe each connection, we extract 12 shape descriptors in addition to traditional dMRI connectivity and tissue microstructure features. We introduce a novel framework, Shape--fused Fiber Cluster Transformer (SFFormer), that leverages a multi-head cross-attention feature fusion module to predict subject-specific language performance based on dMRI tractography. We assess the performance of the method on a large dataset including 1065 healthy young adults. The results demonstrate that both the transformer-based SFFormer model and its inter/intra feature fusion with shape, microstructure, and connectivity are informative, and together, they improve the prediction of subject-specific language performance scores. Overall, our results indicate that the shape of the brain's connections is predictive of human language function. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_19001 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction Lo, Yui Chen, Yuqian Liu, Dongnan Liu, Wan Zekelman, Leo Zhang, Fan Rathi, Yogesh Makris, Nikos Golby, Alexandra J. Cai, Weidong O'Donnell, Lauren J. Computer Vision and Pattern Recognition Artificial Intelligence Image and Video Processing Neurons and Cognition Shape plays an important role in computer graphics, offering informative features to convey an object's morphology and functionality. Shape analysis in brain imaging can help interpret structural and functionality correlations of the human brain. In this work, we investigate the shape of the brain's 3D white matter connections and its potential predictive relationship to human cognitive function. We reconstruct brain connections as sequences of 3D points using diffusion magnetic resonance imaging (dMRI) tractography. To describe each connection, we extract 12 shape descriptors in addition to traditional dMRI connectivity and tissue microstructure features. We introduce a novel framework, Shape--fused Fiber Cluster Transformer (SFFormer), that leverages a multi-head cross-attention feature fusion module to predict subject-specific language performance based on dMRI tractography. We assess the performance of the method on a large dataset including 1065 healthy young adults. The results demonstrate that both the transformer-based SFFormer model and its inter/intra feature fusion with shape, microstructure, and connectivity are informative, and together, they improve the prediction of subject-specific language performance scores. Overall, our results indicate that the shape of the brain's connections is predictive of human language function. |
| title | Cross-domain Fiber Cluster Shape Analysis for Language Performance Cognitive Score Prediction |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Image and Video Processing Neurons and Cognition |
| url | https://arxiv.org/abs/2403.19001 |