Hierarchical Diffusion Framework for Pseudo-Healthy Brain MRI Inpainting with Enhanced 3D Consistency

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kwark, Dou Hoon, Luo, Shirui, Zhu, Xiyue, Li, Yudu, Liang, Zhi-Pei, Kindratenko, Volodymyr
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916861012082688
author Kwark, Dou Hoon
Luo, Shirui
Zhu, Xiyue
Li, Yudu
Liang, Zhi-Pei
Kindratenko, Volodymyr
author_facet Kwark, Dou Hoon
Luo, Shirui
Zhu, Xiyue
Li, Yudu
Liang, Zhi-Pei
Kindratenko, Volodymyr
contents Pseudo-healthy image inpainting is an essential preprocessing step for analyzing pathological brain MRI scans. Most current inpainting methods favor slice-wise 2D models for their high in-plane fidelity, but their independence across slices produces discontinuities in the volume. Fully 3D models alleviate this issue, but their high model capacity demands extensive training data for reliable, high-fidelity synthesis -- often impractical in medical settings. We address these limitations with a hierarchical diffusion framework by replacing direct 3D modeling with two perpendicular coarse-to-fine 2D stages. An axial diffusion model first yields a coarse, globally consistent inpainting; a coronal diffusion model then refines anatomical details. By combining perpendicular spatial views with adaptive resampling, our method balances data efficiency and volumetric consistency. Our experiments show our approach outperforms state-of-the-art baselines in both realism and volumetric consistency, making it a promising solution for pseudo-healthy image inpainting. Code is available at https://github.com/dou0000/3dMRI-Consistent-Inpaint.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17911
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Hierarchical Diffusion Framework for Pseudo-Healthy Brain MRI Inpainting with Enhanced 3D Consistency
Kwark, Dou Hoon
Luo, Shirui
Zhu, Xiyue
Li, Yudu
Liang, Zhi-Pei
Kindratenko, Volodymyr
Image and Video Processing
Computer Vision and Pattern Recognition
Pseudo-healthy image inpainting is an essential preprocessing step for analyzing pathological brain MRI scans. Most current inpainting methods favor slice-wise 2D models for their high in-plane fidelity, but their independence across slices produces discontinuities in the volume. Fully 3D models alleviate this issue, but their high model capacity demands extensive training data for reliable, high-fidelity synthesis -- often impractical in medical settings. We address these limitations with a hierarchical diffusion framework by replacing direct 3D modeling with two perpendicular coarse-to-fine 2D stages. An axial diffusion model first yields a coarse, globally consistent inpainting; a coronal diffusion model then refines anatomical details. By combining perpendicular spatial views with adaptive resampling, our method balances data efficiency and volumetric consistency. Our experiments show our approach outperforms state-of-the-art baselines in both realism and volumetric consistency, making it a promising solution for pseudo-healthy image inpainting. Code is available at https://github.com/dou0000/3dMRI-Consistent-Inpaint.
title Hierarchical Diffusion Framework for Pseudo-Healthy Brain MRI Inpainting with Enhanced 3D Consistency
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.17911