Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Jiacheng, Li, Hao, Yao, Xing, Toubasi, Ahmad, Vinarsky, Taegan, Gheen, Caroline, Derwenskus, Joy, Jin, Chaoyang, Dortch, Richard, Xu, Junzhong, Bagnato, Francesca, Oguz, Ipek
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2511.12396
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914171139915776
author Wang, Jiacheng
Li, Hao
Yao, Xing
Toubasi, Ahmad
Vinarsky, Taegan
Gheen, Caroline
Derwenskus, Joy
Jin, Chaoyang
Dortch, Richard
Xu, Junzhong
Bagnato, Francesca
Oguz, Ipek
author_facet Wang, Jiacheng
Li, Hao
Yao, Xing
Toubasi, Ahmad
Vinarsky, Taegan
Gheen, Caroline
Derwenskus, Joy
Jin, Chaoyang
Dortch, Richard
Xu, Junzhong
Bagnato, Francesca
Oguz, Ipek
contents Quantitative magnetization transfer (qMT) imaging provides myelin-sensitive biomarkers, such as the pool size ratio (PSR), which is valuable for multiple sclerosis (MS) assessment. However, qMT requires specialized 20-30 minute scans. We propose DEMIST to synthesize PSR maps from standard T1w and FLAIR images using a 3D latent diffusion model with three complementary conditioning mechanisms. Our approach has two stages: first, we train separate autoencoders for PSR and anatomical images to learn aligned latent representations. Second, we train a conditional diffusion model in this latent space on top of a frozen diffusion foundation backbone. Conditioning is decoupled into: (i) \textbf{semantic} tokens via cross-attention, (ii) \textbf{spatial} per-scale residual hints via a 3D ControlNet branch, and (iii) \textbf{adaptive} LoRA-modulated attention. We include edge-aware loss terms to preserve lesion boundaries and alignment losses to maintain quantitative consistency, while keeping the number of trainable parameters low and retaining the inductive bias of the pretrained model. We evaluate on 163 scans from 99 subjects using 5-fold cross-validation. Our method outperforms VAE, GAN and diffusion baselines on multiple metrics, producing sharper boundaries and better quantitative agreement with ground truth. Our code is publicly available at https://github.com/MedICL-VU/MS-Synthesis-3DcLDM.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12396
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesis
Wang, Jiacheng
Li, Hao
Yao, Xing
Toubasi, Ahmad
Vinarsky, Taegan
Gheen, Caroline
Derwenskus, Joy
Jin, Chaoyang
Dortch, Richard
Xu, Junzhong
Bagnato, Francesca
Oguz, Ipek
Image and Video Processing
Computer Vision and Pattern Recognition
Quantitative magnetization transfer (qMT) imaging provides myelin-sensitive biomarkers, such as the pool size ratio (PSR), which is valuable for multiple sclerosis (MS) assessment. However, qMT requires specialized 20-30 minute scans. We propose DEMIST to synthesize PSR maps from standard T1w and FLAIR images using a 3D latent diffusion model with three complementary conditioning mechanisms. Our approach has two stages: first, we train separate autoencoders for PSR and anatomical images to learn aligned latent representations. Second, we train a conditional diffusion model in this latent space on top of a frozen diffusion foundation backbone. Conditioning is decoupled into: (i) \textbf{semantic} tokens via cross-attention, (ii) \textbf{spatial} per-scale residual hints via a 3D ControlNet branch, and (iii) \textbf{adaptive} LoRA-modulated attention. We include edge-aware loss terms to preserve lesion boundaries and alignment losses to maintain quantitative consistency, while keeping the number of trainable parameters low and retaining the inductive bias of the pretrained model. We evaluate on 163 scans from 99 subjects using 5-fold cross-validation. Our method outperforms VAE, GAN and diffusion baselines on multiple metrics, producing sharper boundaries and better quantitative agreement with ground truth. Our code is publicly available at https://github.com/MedICL-VU/MS-Synthesis-3DcLDM.
title DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesis
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.12396