Saved in:
Bibliographic Details
Main Authors: Deng, Ziheng, Chen, Hua, Zhou, Yongzheng, Hu, Haibo, Xu, Zhiyong, Sun, Jiayuan, Lyu, Tianling, Xi, Yan, Chen, Yang, Zhao, Jun
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.16361
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917788904325120
author Deng, Ziheng
Chen, Hua
Zhou, Yongzheng
Hu, Haibo
Xu, Zhiyong
Sun, Jiayuan
Lyu, Tianling
Xi, Yan
Chen, Yang
Zhao, Jun
author_facet Deng, Ziheng
Chen, Hua
Zhou, Yongzheng
Hu, Haibo
Xu, Zhiyong
Sun, Jiayuan
Lyu, Tianling
Xi, Yan
Chen, Yang
Zhao, Jun
contents Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. As raw projection data are sorted into multiple respiratory phases, the cone-beam projections become much sparser and the reconstructed 4D CBCT images will be covered by severe streak artifacts. Although several deep learning-based methods have been proposed to address this issue, most algorithms employ 2D network models as backbones, neglecting the intrinsic structural priors within 4D CBCT images. In this paper, we first explore the origin and appearance of streak artifacts in 4D CBCT images. We find that streak artifacts exhibit a unique rotational motion along with the patient's respiration, distinguishable from diaphragm-driven respiratory motion in the spatiotemporal domain. Therefore, we propose a novel 4D neural network model, RSTAR4D-Net, designed to address Rotational STreak Artifact Reduction by integrating the spatial and temporal information within 4D CBCT images. Specifically, we overcome the computational and training difficulties of a 4D neural network. The specially designed model adopts an efficient implementation of 4D convolutions to reduce computational costs and thus can process the whole 4D image in one pass. Additionally, a Tetris training strategy pertinent to the separable 4D convolutions is proposed to effectively train the model using limited 4D training samples. Extensive experiments substantiate the effectiveness of our proposed method, and the RSTAR4D-Net shows superior performance compared to other methods. The source code and dynamic demos are available at https://github.com/ivy9092111111/RSTAR.
format Preprint
id arxiv_https___arxiv_org_abs_2403_16361
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle RSTAR4D: Rotational Streak Artifact Reduction in 4D CBCT using a Separable 4D CNN
Deng, Ziheng
Chen, Hua
Zhou, Yongzheng
Hu, Haibo
Xu, Zhiyong
Sun, Jiayuan
Lyu, Tianling
Xi, Yan
Chen, Yang
Zhao, Jun
Image and Video Processing
Computer Vision and Pattern Recognition
Four-dimensional cone-beam computed tomography (4D CBCT) provides respiration-resolved images and can be used for image-guided radiation therapy. However, the ability to reveal respiratory motion comes at the cost of image artifacts. As raw projection data are sorted into multiple respiratory phases, the cone-beam projections become much sparser and the reconstructed 4D CBCT images will be covered by severe streak artifacts. Although several deep learning-based methods have been proposed to address this issue, most algorithms employ 2D network models as backbones, neglecting the intrinsic structural priors within 4D CBCT images. In this paper, we first explore the origin and appearance of streak artifacts in 4D CBCT images. We find that streak artifacts exhibit a unique rotational motion along with the patient's respiration, distinguishable from diaphragm-driven respiratory motion in the spatiotemporal domain. Therefore, we propose a novel 4D neural network model, RSTAR4D-Net, designed to address Rotational STreak Artifact Reduction by integrating the spatial and temporal information within 4D CBCT images. Specifically, we overcome the computational and training difficulties of a 4D neural network. The specially designed model adopts an efficient implementation of 4D convolutions to reduce computational costs and thus can process the whole 4D image in one pass. Additionally, a Tetris training strategy pertinent to the separable 4D convolutions is proposed to effectively train the model using limited 4D training samples. Extensive experiments substantiate the effectiveness of our proposed method, and the RSTAR4D-Net shows superior performance compared to other methods. The source code and dynamic demos are available at https://github.com/ivy9092111111/RSTAR.
title RSTAR4D: Rotational Streak Artifact Reduction in 4D CBCT using a Separable 4D CNN
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.16361