Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lin, Yiqun, Wang, Hualiang, Chen, Jixiang, Li, Xiaomeng
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909245490855936
author Lin, Yiqun
Wang, Hualiang
Chen, Jixiang
Li, Xiaomeng
author_facet Lin, Yiqun
Wang, Hualiang
Chen, Jixiang
Li, Xiaomeng
contents Cone-Beam Computed Tomography (CBCT) is an indispensable technique in medical imaging, yet the associated radiation exposure raises concerns in clinical practice. To mitigate these risks, sparse-view reconstruction has emerged as an essential research direction, aiming to reduce the radiation dose by utilizing fewer projections for CT reconstruction. Although implicit neural representations have been introduced for sparse-view CBCT reconstruction, existing methods primarily focus on local 2D features queried from sparse projections, which is insufficient to process the more complicated anatomical structures, such as the chest. To this end, we propose a novel reconstruction framework, namely DIF-Gaussian, which leverages 3D Gaussians to represent the feature distribution in the 3D space, offering additional 3D spatial information to facilitate the estimation of attenuation coefficients. Furthermore, we incorporate test-time optimization during inference to further improve the generalization capability of the model. We evaluate DIF-Gaussian on two public datasets, showing significantly superior reconstruction performance than previous state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01090
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction
Lin, Yiqun
Wang, Hualiang
Chen, Jixiang
Li, Xiaomeng
Image and Video Processing
Computer Vision and Pattern Recognition
Cone-Beam Computed Tomography (CBCT) is an indispensable technique in medical imaging, yet the associated radiation exposure raises concerns in clinical practice. To mitigate these risks, sparse-view reconstruction has emerged as an essential research direction, aiming to reduce the radiation dose by utilizing fewer projections for CT reconstruction. Although implicit neural representations have been introduced for sparse-view CBCT reconstruction, existing methods primarily focus on local 2D features queried from sparse projections, which is insufficient to process the more complicated anatomical structures, such as the chest. To this end, we propose a novel reconstruction framework, namely DIF-Gaussian, which leverages 3D Gaussians to represent the feature distribution in the 3D space, offering additional 3D spatial information to facilitate the estimation of attenuation coefficients. Furthermore, we incorporate test-time optimization during inference to further improve the generalization capability of the model. We evaluate DIF-Gaussian on two public datasets, showing significantly superior reconstruction performance than previous state-of-the-art methods.
title Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.01090