Integrating Pathology and CT Imaging for Personalized Recurrence Risk Prediction in Renal Cancer

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Boeke, Daniël, Blommestijn, Cedrik, Wray, Rebecca N., Chupetlovska, Kalina, Gao, Shangqi, Gao, Zeyu, Beets-Tan, Regina G. H., Crispin-Ortuzar, Mireia, Jones, James O., Silva, Wilson, Machado, Ines P.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908509745971200
author Boeke, Daniël
Blommestijn, Cedrik
Wray, Rebecca N.
Chupetlovska, Kalina
Gao, Shangqi
Gao, Zeyu
Beets-Tan, Regina G. H.
Crispin-Ortuzar, Mireia
Jones, James O.
Silva, Wilson
Machado, Ines P.
author_facet Boeke, Daniël
Blommestijn, Cedrik
Wray, Rebecca N.
Chupetlovska, Kalina
Gao, Shangqi
Gao, Zeyu
Beets-Tan, Regina G. H.
Crispin-Ortuzar, Mireia
Jones, James O.
Silva, Wilson
Machado, Ines P.
contents Recurrence risk estimation in clear cell renal cell carcinoma (ccRCC) is essential for guiding postoperative surveillance and treatment. The Leibovich score remains widely used for stratifying distant recurrence risk but offers limited patient-level resolution and excludes imaging information. This study evaluates multimodal recurrence prediction by integrating preoperative computed tomography (CT) and postoperative histopathology whole-slide images (WSIs). A modular deep learning framework with pretrained encoders and Cox-based survival modeling was tested across unimodal, late fusion, and intermediate fusion setups. In a real-world ccRCC cohort, WSI-based models consistently outperformed CT-only models, underscoring the prognostic strength of pathology. Intermediate fusion further improved performance, with the best model (TITAN-CONCH with ResNet-18) approaching the adjusted Leibovich score. Random tie-breaking narrowed the gap between the clinical baseline and learned models, suggesting discretization may overstate individualized performance. Using simple embedding concatenation, radiology added value primarily through fusion. These findings demonstrate the feasibility of foundation model-based multimodal integration for personalized ccRCC risk prediction. Future work should explore more expressive fusion strategies, larger multimodal datasets, and general-purpose CT encoders to better match pathology modeling capacity.
format Preprint
id arxiv_https___arxiv_org_abs_2508_21581
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Integrating Pathology and CT Imaging for Personalized Recurrence Risk Prediction in Renal Cancer
Boeke, Daniël
Blommestijn, Cedrik
Wray, Rebecca N.
Chupetlovska, Kalina
Gao, Shangqi
Gao, Zeyu
Beets-Tan, Regina G. H.
Crispin-Ortuzar, Mireia
Jones, James O.
Silva, Wilson
Machado, Ines P.
Computer Vision and Pattern Recognition
Recurrence risk estimation in clear cell renal cell carcinoma (ccRCC) is essential for guiding postoperative surveillance and treatment. The Leibovich score remains widely used for stratifying distant recurrence risk but offers limited patient-level resolution and excludes imaging information. This study evaluates multimodal recurrence prediction by integrating preoperative computed tomography (CT) and postoperative histopathology whole-slide images (WSIs). A modular deep learning framework with pretrained encoders and Cox-based survival modeling was tested across unimodal, late fusion, and intermediate fusion setups. In a real-world ccRCC cohort, WSI-based models consistently outperformed CT-only models, underscoring the prognostic strength of pathology. Intermediate fusion further improved performance, with the best model (TITAN-CONCH with ResNet-18) approaching the adjusted Leibovich score. Random tie-breaking narrowed the gap between the clinical baseline and learned models, suggesting discretization may overstate individualized performance. Using simple embedding concatenation, radiology added value primarily through fusion. These findings demonstrate the feasibility of foundation model-based multimodal integration for personalized ccRCC risk prediction. Future work should explore more expressive fusion strategies, larger multimodal datasets, and general-purpose CT encoders to better match pathology modeling capacity.
title Integrating Pathology and CT Imaging for Personalized Recurrence Risk Prediction in Renal Cancer
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.21581