MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Andrew, Wang, Hao, Ye, Shuchang, Fulham, Michael, Kim, Jinman
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912367147745280
author Zhang, Andrew
Wang, Hao
Ye, Shuchang
Fulham, Michael
Kim, Jinman
author_facet Zhang, Andrew
Wang, Hao
Ye, Shuchang
Fulham, Michael
Kim, Jinman
contents Patient motion during medical image acquisition causes blurring, ghosting, and distorts organs, which makes image interpretation challenging. Current state-of-the-art algorithms using Generative Adversarial Network (GAN)-based methods with their ability to learn the mappings between corrupted images and their ground truth via Structural Similarity Index Measure (SSIM) loss effectively generate motion-free images. However, we identified the following limitations: (i) they mainly focus on global structural characteristics and therefore overlook localized features that often carry critical pathological information, and (ii) the SSIM loss function struggles to handle images with varying pixel intensities, luminance factors, and variance. In this study, we propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction by: (a) leveraging the foundation model Segment Anything Model (SAM), to dynamically learn spatial patterns along anatomical boundaries where motion artifacts are most pronounced and, (b) introducing the Variance-Selective SSIM (VS-SSIM) loss which adaptively emphasizes spatial regions with high pixel variance to preserve essential anatomical details during artifact correction. Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts, with Peak Signal-to-Noise Ratio (PSNR) increasing by 40%, SSIM by 10%, and Dice by 16%.
format Preprint
id arxiv_https___arxiv_org_abs_2505_04105
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction
Zhang, Andrew
Wang, Hao
Ye, Shuchang
Fulham, Michael
Kim, Jinman
Image and Video Processing
Computer Vision and Pattern Recognition
Patient motion during medical image acquisition causes blurring, ghosting, and distorts organs, which makes image interpretation challenging. Current state-of-the-art algorithms using Generative Adversarial Network (GAN)-based methods with their ability to learn the mappings between corrupted images and their ground truth via Structural Similarity Index Measure (SSIM) loss effectively generate motion-free images. However, we identified the following limitations: (i) they mainly focus on global structural characteristics and therefore overlook localized features that often carry critical pathological information, and (ii) the SSIM loss function struggles to handle images with varying pixel intensities, luminance factors, and variance. In this study, we propose Motion-Aware Image SYnthesis (MAISY) which initially characterize motion and then uses it for correction by: (a) leveraging the foundation model Segment Anything Model (SAM), to dynamically learn spatial patterns along anatomical boundaries where motion artifacts are most pronounced and, (b) introducing the Variance-Selective SSIM (VS-SSIM) loss which adaptively emphasizes spatial regions with high pixel variance to preserve essential anatomical details during artifact correction. Experiments on chest and head CT datasets demonstrate that our model outperformed the state-of-the-art counterparts, with Peak Signal-to-Noise Ratio (PSNR) increasing by 40%, SSIM by 10%, and Dice by 16%.
title MAISY: Motion-Aware Image SYnthesis for Medical Image Motion Correction
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.04105