Coarse-Fine View Attention Alignment-Based GAN for CT Reconstruction from Biplanar X-Rays
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914915712761856 |
|---|---|
| author | Qiao, Zhi Ouyang, Hanqiang Chu, Dongheng Yuan, Huishu Zhen, Xiantong Dong, Pei Qian, Zhen |
| author_facet | Qiao, Zhi Ouyang, Hanqiang Chu, Dongheng Yuan, Huishu Zhen, Xiantong Dong, Pei Qian, Zhen |
| contents | For surgical planning and intra-operation imaging, CT reconstruction using X-ray images can potentially be an important alternative when CT imaging is not available or not feasible. In this paper, we aim to use biplanar X-rays to reconstruct a 3D CT image, because biplanar X-rays convey richer information than single-view X-rays and are more commonly used by surgeons. Different from previous studies in which the two X-ray views were treated indifferently when fusing the cross-view data, we propose a novel attention-informed coarse-to-fine cross-view fusion method to combine the features extracted from the orthogonal biplanar views. This method consists of a view attention alignment sub-module and a fine-distillation sub-module that are designed to work together to highlight the unique or complementary information from each of the views. Experiments have demonstrated the superiority of our proposed method over the SOTA methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_09736 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Coarse-Fine View Attention Alignment-Based GAN for CT Reconstruction from Biplanar X-Rays Qiao, Zhi Ouyang, Hanqiang Chu, Dongheng Yuan, Huishu Zhen, Xiantong Dong, Pei Qian, Zhen Image and Video Processing Computer Vision and Pattern Recognition For surgical planning and intra-operation imaging, CT reconstruction using X-ray images can potentially be an important alternative when CT imaging is not available or not feasible. In this paper, we aim to use biplanar X-rays to reconstruct a 3D CT image, because biplanar X-rays convey richer information than single-view X-rays and are more commonly used by surgeons. Different from previous studies in which the two X-ray views were treated indifferently when fusing the cross-view data, we propose a novel attention-informed coarse-to-fine cross-view fusion method to combine the features extracted from the orthogonal biplanar views. This method consists of a view attention alignment sub-module and a fine-distillation sub-module that are designed to work together to highlight the unique or complementary information from each of the views. Experiments have demonstrated the superiority of our proposed method over the SOTA methods. |
| title | Coarse-Fine View Attention Alignment-Based GAN for CT Reconstruction from Biplanar X-Rays |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2408.09736 |