Anatomical feature-prioritized loss for enhanced MR to CT translation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Longuefosse, Arthur, de Senneville, Baudouin Denis, Dournes, Gael, Benlala, Ilyes, Desbarats, Pascal, Baldacci, Fabien
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915505149837312
author Longuefosse, Arthur
de Senneville, Baudouin Denis
Dournes, Gael
Benlala, Ilyes
Desbarats, Pascal
Baldacci, Fabien
author_facet Longuefosse, Arthur
de Senneville, Baudouin Denis
Dournes, Gael
Benlala, Ilyes
Desbarats, Pascal
Baldacci, Fabien
contents In medical image synthesis, the precision of localized structural details is crucial, particularly when addressing specific clinical requirements such as the identification and measurement of fine structures. Traditional methods for image translation and synthesis are generally optimized for global image reconstruction but often fall short in providing the finesse required for detailed local analysis. This study represents a step toward addressing this challenge by introducing a novel anatomical feature-prioritized (AFP) loss function into the synthesis process. This method enhances reconstruction by focusing on clinically significant structures, utilizing features from a pre-trained model designed for a specific downstream task, such as the segmentation of particular anatomical regions. The AFP loss function can replace or complement global reconstruction methods, ensuring a balanced emphasis on both global image fidelity and local structural details. Various implementations of this loss function are explored, including its integration into different synthesis networks such as GAN-based and CNN-based models. Our approach is applied and evaluated in two contexts: lung MR to CT translation, focusing on high-quality reconstruction of bronchial structures, using a private dataset; and pelvis MR to CT synthesis, targeting the accurate representation of organs and muscles, utilizing a public dataset from the Synthrad2023 challenge. We leverage embeddings from pre-trained segmentation models specific to these anatomical regions to demonstrate the capability of the AFP loss to prioritize and accurately reconstruct essential features. This tailored approach shows promising potential for enhancing the specificity and practicality of medical image synthesis in clinical applications.
format Preprint
id arxiv_https___arxiv_org_abs_2410_10328
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Anatomical feature-prioritized loss for enhanced MR to CT translation
Longuefosse, Arthur
de Senneville, Baudouin Denis
Dournes, Gael
Benlala, Ilyes
Desbarats, Pascal
Baldacci, Fabien
Image and Video Processing
Computer Vision and Pattern Recognition
In medical image synthesis, the precision of localized structural details is crucial, particularly when addressing specific clinical requirements such as the identification and measurement of fine structures. Traditional methods for image translation and synthesis are generally optimized for global image reconstruction but often fall short in providing the finesse required for detailed local analysis. This study represents a step toward addressing this challenge by introducing a novel anatomical feature-prioritized (AFP) loss function into the synthesis process. This method enhances reconstruction by focusing on clinically significant structures, utilizing features from a pre-trained model designed for a specific downstream task, such as the segmentation of particular anatomical regions. The AFP loss function can replace or complement global reconstruction methods, ensuring a balanced emphasis on both global image fidelity and local structural details. Various implementations of this loss function are explored, including its integration into different synthesis networks such as GAN-based and CNN-based models. Our approach is applied and evaluated in two contexts: lung MR to CT translation, focusing on high-quality reconstruction of bronchial structures, using a private dataset; and pelvis MR to CT synthesis, targeting the accurate representation of organs and muscles, utilizing a public dataset from the Synthrad2023 challenge. We leverage embeddings from pre-trained segmentation models specific to these anatomical regions to demonstrate the capability of the AFP loss to prioritize and accurately reconstruct essential features. This tailored approach shows promising potential for enhancing the specificity and practicality of medical image synthesis in clinical applications.
title Anatomical feature-prioritized loss for enhanced MR to CT translation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.10328