UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Jing, Fan, Qinrui, Hu, Shu, Lyu, Siwei, Wu, Xi, Wang, Xin
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916149472526336
author Hu, Jing
Fan, Qinrui
Hu, Shu
Lyu, Siwei
Wu, Xi
Wang, Xin
author_facet Hu, Jing
Fan, Qinrui
Hu, Shu
Lyu, Siwei
Wu, Xi
Wang, Xin
contents In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including multi-planar slices and three-dimensional structures for clinical diagnosis. However, CT imaging requires patients to be exposed to large doses of ionizing radiation for a long time, which may cause irreversible physical harm. In this paper, we propose an Uncertainty-aware MedNeRF (UMedNeRF) network based on generated radiation fields. The network can learn a continuous representation of CT projections from 2D X-ray images by obtaining the internal structure and depth information and using adaptive loss weights to ensure the quality of the generated images. Our model is trained on publicly available knee and chest datasets, and we show the results of CT projection rendering with a single X-ray and compare our method with other methods based on generated radiation fields.
format Preprint
id arxiv_https___arxiv_org_abs_2311_05836
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields
Hu, Jing
Fan, Qinrui
Hu, Shu
Lyu, Siwei
Wu, Xi
Wang, Xin
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
In the field of clinical medicine, computed tomography (CT) is an effective medical imaging modality for the diagnosis of various pathologies. Compared with X-ray images, CT images can provide more information, including multi-planar slices and three-dimensional structures for clinical diagnosis. However, CT imaging requires patients to be exposed to large doses of ionizing radiation for a long time, which may cause irreversible physical harm. In this paper, we propose an Uncertainty-aware MedNeRF (UMedNeRF) network based on generated radiation fields. The network can learn a continuous representation of CT projections from 2D X-ray images by obtaining the internal structure and depth information and using adaptive loss weights to ensure the quality of the generated images. Our model is trained on publicly available knee and chest datasets, and we show the results of CT projection rendering with a single X-ray and compare our method with other methods based on generated radiation fields.
title UMedNeRF: Uncertainty-aware Single View Volumetric Rendering for Medical Neural Radiance Fields
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2311.05836