Beyond the Lungs: Extending the Field of View in Chest CT with Latent Diffusion Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zuo, Lianrui, Xu, Kaiwen, Su, Dingjie, Yu, Xin, Krishnan, Aravind R., Liu, Yihao, Bao, Shunxing, Li, Thomas, Sandler, Kim L., Maldonado, Fabien, Landman, Bennett A.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916577853571072
author Zuo, Lianrui
Xu, Kaiwen
Su, Dingjie
Yu, Xin
Krishnan, Aravind R.
Liu, Yihao
Bao, Shunxing
Li, Thomas
Sandler, Kim L.
Maldonado, Fabien
Landman, Bennett A.
author_facet Zuo, Lianrui
Xu, Kaiwen
Su, Dingjie
Yu, Xin
Krishnan, Aravind R.
Liu, Yihao
Bao, Shunxing
Li, Thomas
Sandler, Kim L.
Maldonado, Fabien
Landman, Bennett A.
contents The interconnection between the human lungs and other organs, such as the liver and kidneys, is crucial for understanding the underlying risks and effects of lung diseases and improving patient care. However, most research chest CT imaging is focused solely on the lungs due to considerations of cost and radiation dose. This restricted field of view (FOV) in the acquired images poses challenges to comprehensive analysis and hinders the ability to gain insights into the impact of lung diseases on other organs. To address this, we propose SCOPE (Spatial Coverage Optimization with Prior Encoding), a novel approach to capture the inter-organ relationships from CT images and extend the FOV of chest CT images. Our approach first trains a variational autoencoder (VAE) to encode 2D axial CT slices individually, then stacks the latent representations of the VAE to form a 3D context for training a latent diffusion model. Once trained, our approach extends the FOV of CT images in the z-direction by generating new axial slices in a zero-shot manner. We evaluated our approach on the National Lung Screening Trial (NLST) dataset, and results suggest that it effectively extends the FOV to include the liver and kidneys, which are not completely covered in the original NLST data acquisition. Quantitative results on a held-out whole-body dataset demonstrate that the generated slices exhibit high fidelity with acquired data, achieving an SSIM of 0.81.
format Preprint
id arxiv_https___arxiv_org_abs_2501_13068
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Beyond the Lungs: Extending the Field of View in Chest CT with Latent Diffusion Models
Zuo, Lianrui
Xu, Kaiwen
Su, Dingjie
Yu, Xin
Krishnan, Aravind R.
Liu, Yihao
Bao, Shunxing
Li, Thomas
Sandler, Kim L.
Maldonado, Fabien
Landman, Bennett A.
Computer Vision and Pattern Recognition
Image and Video Processing
The interconnection between the human lungs and other organs, such as the liver and kidneys, is crucial for understanding the underlying risks and effects of lung diseases and improving patient care. However, most research chest CT imaging is focused solely on the lungs due to considerations of cost and radiation dose. This restricted field of view (FOV) in the acquired images poses challenges to comprehensive analysis and hinders the ability to gain insights into the impact of lung diseases on other organs. To address this, we propose SCOPE (Spatial Coverage Optimization with Prior Encoding), a novel approach to capture the inter-organ relationships from CT images and extend the FOV of chest CT images. Our approach first trains a variational autoencoder (VAE) to encode 2D axial CT slices individually, then stacks the latent representations of the VAE to form a 3D context for training a latent diffusion model. Once trained, our approach extends the FOV of CT images in the z-direction by generating new axial slices in a zero-shot manner. We evaluated our approach on the National Lung Screening Trial (NLST) dataset, and results suggest that it effectively extends the FOV to include the liver and kidneys, which are not completely covered in the original NLST data acquisition. Quantitative results on a held-out whole-body dataset demonstrate that the generated slices exhibit high fidelity with acquired data, achieving an SSIM of 0.81.
title Beyond the Lungs: Extending the Field of View in Chest CT with Latent Diffusion Models
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2501.13068