To deform or not: treatment-aware longitudinal registration for breast DCE-MRI during neoadjuvant chemotherapy via unsupervised keypoints detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Han, Luyi, Tan, Tao, Zhang, Tianyu, Gao, Yuan, Wang, Xin, Longo, Valentina, Ventura-Díaz, Sofía, D'Angelo, Anna, Teuwen, Jonas, Mann, Ritse
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917569764524032
author Han, Luyi
Tan, Tao
Zhang, Tianyu
Gao, Yuan
Wang, Xin
Longo, Valentina
Ventura-Díaz, Sofía
D'Angelo, Anna
Teuwen, Jonas
Mann, Ritse
author_facet Han, Luyi
Tan, Tao
Zhang, Tianyu
Gao, Yuan
Wang, Xin
Longo, Valentina
Ventura-Díaz, Sofía
D'Angelo, Anna
Teuwen, Jonas
Mann, Ritse
contents Clinicians compare breast DCE-MRI after neoadjuvant chemotherapy (NAC) with pre-treatment scans to evaluate the response to NAC. Clinical evidence supports that accurate longitudinal deformable registration without deforming treated tumor regions is key to quantifying tumor changes. We propose a conditional pyramid registration network based on unsupervised keypoint detection and selective volume-preserving to quantify changes over time. In this approach, we extract the structural and the abnormal keypoints from DCE-MRI, apply the structural keypoints for the registration algorithm to restrict large deformation, and employ volume-preserving loss based on abnormal keypoints to keep the volume of the tumor unchanged after registration. We use a clinical dataset with 1630 MRI scans from 314 patients treated with NAC. The results demonstrate that our method registers with better performance and better volume preservation of the tumors. Furthermore, a local-global-combining biomarker based on the proposed method achieves high accuracy in pathological complete response (pCR) prediction, indicating that predictive information exists outside tumor regions. The biomarkers could potentially be used to avoid unnecessary surgeries for certain patients. It may be valuable for clinicians and/or computer systems to conduct follow-up tumor segmentation and response prediction on images registered by our method. Our code is available on \url{https://github.com/fiy2W/Treatment-aware-Longitudinal-Registration}.
format Preprint
id arxiv_https___arxiv_org_abs_2401_09336
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle To deform or not: treatment-aware longitudinal registration for breast DCE-MRI during neoadjuvant chemotherapy via unsupervised keypoints detection
Han, Luyi
Tan, Tao
Zhang, Tianyu
Gao, Yuan
Wang, Xin
Longo, Valentina
Ventura-Díaz, Sofía
D'Angelo, Anna
Teuwen, Jonas
Mann, Ritse
Image and Video Processing
Computer Vision and Pattern Recognition
Clinicians compare breast DCE-MRI after neoadjuvant chemotherapy (NAC) with pre-treatment scans to evaluate the response to NAC. Clinical evidence supports that accurate longitudinal deformable registration without deforming treated tumor regions is key to quantifying tumor changes. We propose a conditional pyramid registration network based on unsupervised keypoint detection and selective volume-preserving to quantify changes over time. In this approach, we extract the structural and the abnormal keypoints from DCE-MRI, apply the structural keypoints for the registration algorithm to restrict large deformation, and employ volume-preserving loss based on abnormal keypoints to keep the volume of the tumor unchanged after registration. We use a clinical dataset with 1630 MRI scans from 314 patients treated with NAC. The results demonstrate that our method registers with better performance and better volume preservation of the tumors. Furthermore, a local-global-combining biomarker based on the proposed method achieves high accuracy in pathological complete response (pCR) prediction, indicating that predictive information exists outside tumor regions. The biomarkers could potentially be used to avoid unnecessary surgeries for certain patients. It may be valuable for clinicians and/or computer systems to conduct follow-up tumor segmentation and response prediction on images registered by our method. Our code is available on \url{https://github.com/fiy2W/Treatment-aware-Longitudinal-Registration}.
title To deform or not: treatment-aware longitudinal registration for breast DCE-MRI during neoadjuvant chemotherapy via unsupervised keypoints detection
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.09336