Spatiotemporal Gaussian Optimization for 4D Cone Beam CT Reconstruction from Sparse Projections

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fu, Yabo, Zhang, Hao, Cai, Weixing, Xie, Huiqiao, Kuo, Licheng, Cervino, Laura, Moran, Jean, Li, Xiang, Li, Tianfang
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909451041112064
author Fu, Yabo
Zhang, Hao
Cai, Weixing
Xie, Huiqiao
Kuo, Licheng
Cervino, Laura
Moran, Jean
Li, Xiang
Li, Tianfang
author_facet Fu, Yabo
Zhang, Hao
Cai, Weixing
Xie, Huiqiao
Kuo, Licheng
Cervino, Laura
Moran, Jean
Li, Xiang
Li, Tianfang
contents In image-guided radiotherapy (IGRT), four-dimensional cone-beam computed tomography (4D-CBCT) is critical for assessing tumor motion during a patients breathing cycle prior to beam delivery. However, generating 4D-CBCT images with sufficient quality requires significantly more projection images than a standard 3D-CBCT scan, leading to extended scanning times and increased imaging dose to the patient. To address these limitations, there is a strong demand for methods capable of reconstructing high-quality 4D-CBCT images from a 1-minute 3D-CBCT acquisition. The challenge lies in the sparse sampling of projections, which introduces severe streaking artifacts and compromises image quality. This paper introduces a novel framework leveraging spatiotemporal Gaussian representation for 4D-CBCT reconstruction from sparse projections, achieving a balance between streak artifact reduction, dynamic motion preservation, and fine detail restoration. Each Gaussian is characterized by its 3D position, covariance, rotation, and density. Two-dimensional X-ray projection images can be rendered from the Gaussian point cloud representation via X-ray rasterization. The properties of each Gaussian were optimized by minimizing the discrepancy between the measured projections and the rendered X-ray projections. A Gaussian deformation network is jointly optimized to deform these Gaussian properties to obtain a 4D Gaussian representation for dynamic CBCT scene modeling. The final 4D-CBCT images are reconstructed by voxelizing the 4D Gaussians, achieving a high-quality representation that preserves both motion dynamics and spatial detail. The code and reconstruction results can be found at https://github.com/fuyabo/4DGS_for_4DCBCT/tree/main
format Preprint
id arxiv_https___arxiv_org_abs_2501_04140
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Spatiotemporal Gaussian Optimization for 4D Cone Beam CT Reconstruction from Sparse Projections
Fu, Yabo
Zhang, Hao
Cai, Weixing
Xie, Huiqiao
Kuo, Licheng
Cervino, Laura
Moran, Jean
Li, Xiang
Li, Tianfang
Medical Physics
Image and Video Processing
In image-guided radiotherapy (IGRT), four-dimensional cone-beam computed tomography (4D-CBCT) is critical for assessing tumor motion during a patients breathing cycle prior to beam delivery. However, generating 4D-CBCT images with sufficient quality requires significantly more projection images than a standard 3D-CBCT scan, leading to extended scanning times and increased imaging dose to the patient. To address these limitations, there is a strong demand for methods capable of reconstructing high-quality 4D-CBCT images from a 1-minute 3D-CBCT acquisition. The challenge lies in the sparse sampling of projections, which introduces severe streaking artifacts and compromises image quality. This paper introduces a novel framework leveraging spatiotemporal Gaussian representation for 4D-CBCT reconstruction from sparse projections, achieving a balance between streak artifact reduction, dynamic motion preservation, and fine detail restoration. Each Gaussian is characterized by its 3D position, covariance, rotation, and density. Two-dimensional X-ray projection images can be rendered from the Gaussian point cloud representation via X-ray rasterization. The properties of each Gaussian were optimized by minimizing the discrepancy between the measured projections and the rendered X-ray projections. A Gaussian deformation network is jointly optimized to deform these Gaussian properties to obtain a 4D Gaussian representation for dynamic CBCT scene modeling. The final 4D-CBCT images are reconstructed by voxelizing the 4D Gaussians, achieving a high-quality representation that preserves both motion dynamics and spatial detail. The code and reconstruction results can be found at https://github.com/fuyabo/4DGS_for_4DCBCT/tree/main
title Spatiotemporal Gaussian Optimization for 4D Cone Beam CT Reconstruction from Sparse Projections
topic Medical Physics
Image and Video Processing
url https://arxiv.org/abs/2501.04140