A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Jiang, Caiwen, Ding, Yuzhen, Jia, Mi, Patel, Samir H., Sio, Terence T., Ashman, Jonathan B., McGee, Lisa A., Rwigema, Jean-Claude M., Rule, William G., Keole, Sameer R., Vora, Sujay A., Wong, William W., Yu, Nathan Y., Halyard, Michele Y., Schild, Steven E., Shen, Dinggang, Liu, Wei
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911594529685504
author Jiang, Caiwen
Ding, Yuzhen
Jia, Mi
Patel, Samir H.
Sio, Terence T.
Ashman, Jonathan B.
McGee, Lisa A.
Rwigema, Jean-Claude M.
Rule, William G.
Keole, Sameer R.
Vora, Sujay A.
Wong, William W.
Yu, Nathan Y.
Halyard, Michele Y.
Schild, Steven E.
Shen, Dinggang
Liu, Wei
author_facet Jiang, Caiwen
Ding, Yuzhen
Jia, Mi
Patel, Samir H.
Sio, Terence T.
Ashman, Jonathan B.
McGee, Lisa A.
Rwigema, Jean-Claude M.
Rule, William G.
Keole, Sameer R.
Vora, Sujay A.
Wong, William W.
Yu, Nathan Y.
Halyard, Michele Y.
Schild, Steven E.
Shen, Dinggang
Liu, Wei
contents Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for emerging online adaptive workflows, while existing deep learning-based approaches are primarily designed for generic benchmarks and underutilize clinically relevant information beyond images. To address this gap, we propose a clinically scalable coarse-to-fine deformable registration framework that integrates multimodal information from the proton radiotherapy workflow to accommodate diverse clinical scenarios. The model employs dual CNN-based encoders for hierarchical feature extraction and a transformer-based decoder to progressively refine deformation fields. Beyond CT intensities, clinically critical priors, including target and organ-at-risk contours, dose distributions, and treatment planning text, are incorporated through anatomy- and risk-guided attention, text-conditioned feature modulation, and foreground-aware optimization, enabling anatomically focused and clinically informed deformation estimation. We evaluate the proposed framework on a large-scale proton therapy DIR dataset comprising 1,222 paired planning and repeat CT scans across multiple anatomical regions and disease types. Extensive experiments demonstrate consistent improvements over state-of-the-art methods, enabling fast and robust clinically meaningful registration.
format Preprint
id arxiv_https___arxiv_org_abs_2604_13397
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy
Jiang, Caiwen
Ding, Yuzhen
Jia, Mi
Patel, Samir H.
Sio, Terence T.
Ashman, Jonathan B.
McGee, Lisa A.
Rwigema, Jean-Claude M.
Rule, William G.
Keole, Sameer R.
Vora, Sujay A.
Wong, William W.
Yu, Nathan Y.
Halyard, Michele Y.
Schild, Steven E.
Shen, Dinggang
Liu, Wei
Computer Vision and Pattern Recognition
Proton therapy offers superior organ-at-risk sparing but is highly sensitive to anatomical changes, making accurate deformable image registration (DIR) across longitudinal CT scans essential. Conventional DIR methods are often too slow for emerging online adaptive workflows, while existing deep learning-based approaches are primarily designed for generic benchmarks and underutilize clinically relevant information beyond images. To address this gap, we propose a clinically scalable coarse-to-fine deformable registration framework that integrates multimodal information from the proton radiotherapy workflow to accommodate diverse clinical scenarios. The model employs dual CNN-based encoders for hierarchical feature extraction and a transformer-based decoder to progressively refine deformation fields. Beyond CT intensities, clinically critical priors, including target and organ-at-risk contours, dose distributions, and treatment planning text, are incorporated through anatomy- and risk-guided attention, text-conditioned feature modulation, and foreground-aware optimization, enabling anatomically focused and clinically informed deformation estimation. We evaluate the proposed framework on a large-scale proton therapy DIR dataset comprising 1,222 paired planning and repeat CT scans across multiple anatomical regions and disease types. Extensive experiments demonstrate consistent improvements over state-of-the-art methods, enabling fast and robust clinically meaningful registration.
title A Multimodal Clinically Informed Coarse-to-Fine Framework for Longitudinal CT Registration in Proton Therapy
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.13397