NeRF-based CBCT Reconstruction needs Normalization and Initialization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Zhuowei, Li, Han, Sun, Dai, Li, Zhicheng, Li, Yujia, Kong, Qingpeng, Cheng, Zhiwei, Navab, Nassir, Zhou, S. Kevin
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908419695312896
author Xu, Zhuowei
Li, Han
Sun, Dai
Li, Zhicheng
Li, Yujia
Kong, Qingpeng
Cheng, Zhiwei
Navab, Nassir
Zhou, S. Kevin
author_facet Xu, Zhuowei
Li, Han
Sun, Dai
Li, Zhicheng
Li, Yujia
Kong, Qingpeng
Cheng, Zhiwei
Navab, Nassir
Zhou, S. Kevin
contents Cone Beam Computed Tomography (CBCT) is widely used in medical imaging. However, the limited number and intensity of X-ray projections make reconstruction an ill-posed problem with severe artifacts. NeRF-based methods have achieved great success in this task. However, they suffer from a local-global training mismatch between their two key components: the hash encoder and the neural network. Specifically, in each training step, only a subset of the hash encoder's parameters is used (local sparse), whereas all parameters in the neural network participate (global dense). Consequently, hash features generated in each step are highly misaligned, as they come from different subsets of the hash encoder. These misalignments from different training steps are then fed into the neural network, causing repeated inconsistent global updates in training, which leads to unstable training, slower convergence, and degraded reconstruction quality. Aiming to alleviate the impact of this local-global optimization mismatch, we introduce a Normalized Hash Encoder, which enhances feature consistency and mitigates the mismatch. Additionally, we propose a Mapping Consistency Initialization(MCI) strategy that initializes the neural network before training by leveraging the global mapping property from a well-trained model. The initialized neural network exhibits improved stability during early training, enabling faster convergence and enhanced reconstruction performance. Our method is simple yet effective, requiring only a few lines of code while substantially improving training efficiency on 128 CT cases collected from 4 different datasets, covering 7 distinct anatomical regions.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19742
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle NeRF-based CBCT Reconstruction needs Normalization and Initialization
Xu, Zhuowei
Li, Han
Sun, Dai
Li, Zhicheng
Li, Yujia
Kong, Qingpeng
Cheng, Zhiwei
Navab, Nassir
Zhou, S. Kevin
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Cone Beam Computed Tomography (CBCT) is widely used in medical imaging. However, the limited number and intensity of X-ray projections make reconstruction an ill-posed problem with severe artifacts. NeRF-based methods have achieved great success in this task. However, they suffer from a local-global training mismatch between their two key components: the hash encoder and the neural network. Specifically, in each training step, only a subset of the hash encoder's parameters is used (local sparse), whereas all parameters in the neural network participate (global dense). Consequently, hash features generated in each step are highly misaligned, as they come from different subsets of the hash encoder. These misalignments from different training steps are then fed into the neural network, causing repeated inconsistent global updates in training, which leads to unstable training, slower convergence, and degraded reconstruction quality. Aiming to alleviate the impact of this local-global optimization mismatch, we introduce a Normalized Hash Encoder, which enhances feature consistency and mitigates the mismatch. Additionally, we propose a Mapping Consistency Initialization(MCI) strategy that initializes the neural network before training by leveraging the global mapping property from a well-trained model. The initialized neural network exhibits improved stability during early training, enabling faster convergence and enhanced reconstruction performance. Our method is simple yet effective, requiring only a few lines of code while substantially improving training efficiency on 128 CT cases collected from 4 different datasets, covering 7 distinct anatomical regions.
title NeRF-based CBCT Reconstruction needs Normalization and Initialization
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.19742