A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917451504025600 |
|---|---|
| author | Rao, Chinmay van Osch, Matthias Pezzotti, Nicola de Bresser, Jeroen van Buchem, Mark Beljaards, Laurens Meineke, Jakob de Weerdt, Elwin Lu, Huangling Doneva, Mariya Staring, Marius |
| author_facet | Rao, Chinmay van Osch, Matthias Pezzotti, Nicola de Bresser, Jeroen van Buchem, Mark Beljaards, Laurens Meineke, Jakob de Weerdt, Elwin Lu, Huangling Doneva, Mariya Staring, Marius |
| contents | Since the various MR contrasts of a given anatomy contain redundant information, one contrast can be used to guide the reconstruction of another undersampled contrast acquired subsequently in the same session. To solve this reconstruction problem leveraging multi-contrast side information, several end-to-end learning-based methods have been proposed. However, a key challenge is the requirement for large paired training datasets comprising raw k-space data and aligned reference images. We propose a modular plug-and-play method, which requires no k-space training data and relies solely on partially paired image-domain datasets. A content/style model of two-contrast MR image data is first learned and subsequently applied as a plug-and-play operator in iterative reconstruction. The disentanglement of content and style allows explicit representation of contrast-independent and contrast-specific factors. Consequently, incorporating prior information into the reconstruction reduces to a simple replacement operation on the aliased content of the estimated image using high-quality content derived from the reference scan. Combining this operation with an MR data consistency step, followed by a corrective procedure for the content estimate, yields an iterative scheme. We name this novel approach PnP-CoSMo. It offers, by design, cross-contrast generalizability and provides an explanatory framework based on the shared and non-shared generative factors underlying the two given contrasts. We explore various aspects, including interpretability and convergence, via simulations. Furthermore, its practicality is demonstrated on the public NYU fastMRI DICOM dataset, showing equivalent or superior quality and greater generalizability compared to end-to-end methods. On two in-house multi-coil datasets, PnP-CoSMo enabled up to 32.6% greater acceleration over non-guided reconstruction at given SSIM. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_13477 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling Rao, Chinmay van Osch, Matthias Pezzotti, Nicola de Bresser, Jeroen van Buchem, Mark Beljaards, Laurens Meineke, Jakob de Weerdt, Elwin Lu, Huangling Doneva, Mariya Staring, Marius Image and Video Processing Computer Vision and Pattern Recognition Medical Physics I.4.5 Since the various MR contrasts of a given anatomy contain redundant information, one contrast can be used to guide the reconstruction of another undersampled contrast acquired subsequently in the same session. To solve this reconstruction problem leveraging multi-contrast side information, several end-to-end learning-based methods have been proposed. However, a key challenge is the requirement for large paired training datasets comprising raw k-space data and aligned reference images. We propose a modular plug-and-play method, which requires no k-space training data and relies solely on partially paired image-domain datasets. A content/style model of two-contrast MR image data is first learned and subsequently applied as a plug-and-play operator in iterative reconstruction. The disentanglement of content and style allows explicit representation of contrast-independent and contrast-specific factors. Consequently, incorporating prior information into the reconstruction reduces to a simple replacement operation on the aliased content of the estimated image using high-quality content derived from the reference scan. Combining this operation with an MR data consistency step, followed by a corrective procedure for the content estimate, yields an iterative scheme. We name this novel approach PnP-CoSMo. It offers, by design, cross-contrast generalizability and provides an explanatory framework based on the shared and non-shared generative factors underlying the two given contrasts. We explore various aspects, including interpretability and convergence, via simulations. Furthermore, its practicality is demonstrated on the public NYU fastMRI DICOM dataset, showing equivalent or superior quality and greater generalizability compared to end-to-end methods. On two in-house multi-coil datasets, PnP-CoSMo enabled up to 32.6% greater acceleration over non-guided reconstruction at given SSIM. |
| title | A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling |
| topic | Image and Video Processing Computer Vision and Pattern Recognition Medical Physics I.4.5 |
| url | https://arxiv.org/abs/2409.13477 |