Saved in:
Bibliographic Details
Main Authors: Baur, Simon, Ruhwedel, Tristan, Böke, Ekin, Kobus, Zuzanna, Lishkova, Gergana, Wetz, Christoph, Amthauer, Holger, Roderburg, Christoph, Tacke, Frank, Rogasch, Julian M., Samek, Wojciech, Jann, Henning, Ma, Jackie, Eschrich, Johannes
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.05169
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908635883372544
author Baur, Simon
Ruhwedel, Tristan
Böke, Ekin
Kobus, Zuzanna
Lishkova, Gergana
Wetz, Christoph
Amthauer, Holger
Roderburg, Christoph
Tacke, Frank
Rogasch, Julian M.
Samek, Wojciech
Jann, Henning
Ma, Jackie
Eschrich, Johannes
author_facet Baur, Simon
Ruhwedel, Tristan
Böke, Ekin
Kobus, Zuzanna
Lishkova, Gergana
Wetz, Christoph
Amthauer, Holger
Roderburg, Christoph
Tacke, Frank
Rogasch, Julian M.
Samek, Wojciech
Jann, Henning
Ma, Jackie
Eschrich, Johannes
contents Peptide receptor radionuclide therapy (PRRT) is an established treatment for metastatic neuroendocrine tumors (NETs), yet long-term disease control occurs only in a subset of patients. Predicting progression-free survival (PFS) could support individualized treatment planning. This study evaluates laboratory, imaging, and multimodal deep learning models for PFS prediction in PRRT-treated patients. In this retrospective, single-center study 116 patients with metastatic NETs undergoing 177Lu-DOTATOC were included. Clinical characteristics, laboratory values, and pretherapeutic somatostatin receptor positron emission tomography/computed tomographies (SR-PET/CT) were collected. Seven models were trained to classify low- vs. high-PFS groups, including unimodal (laboratory, SR-PET, or CT) and multimodal fusion approaches. Explainability was evaluated by feature importance analysis and gradient maps. Forty-two patients (36%) had short PFS (< 1 year), 74 patients long PFS (>1 year). Groups were similar in most characteristics, except for higher baseline chromogranin A (p = 0.003), elevated gamma-GT (p = 0.002), and fewer PRRT cycles (p < 0.001) in short-PFS patients. The Random Forest model trained only on laboratory biomarkers reached an AUROC of 0.59 +- 0.02. Unimodal three-dimensional convolutional neural networks using SR-PET or CT performed worse (AUROC 0.42 +- 0.03 and 0.54 +- 0.01, respectively). A multimodal fusion model laboratory values, SR-PET, and CT -augmented with a pretrained CT branch - achieved the best results (AUROC 0.72 +- 0.01, AUPRC 0.80 +- 0.01). Multimodal deep learning combining SR-PET, CT, and laboratory biomarkers outperformed unimodal approaches for PFS prediction after PRRT. Upon external validation, such models may support risk-adapted follow-up strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05169
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy
Baur, Simon
Ruhwedel, Tristan
Böke, Ekin
Kobus, Zuzanna
Lishkova, Gergana
Wetz, Christoph
Amthauer, Holger
Roderburg, Christoph
Tacke, Frank
Rogasch, Julian M.
Samek, Wojciech
Jann, Henning
Ma, Jackie
Eschrich, Johannes
Machine Learning
Peptide receptor radionuclide therapy (PRRT) is an established treatment for metastatic neuroendocrine tumors (NETs), yet long-term disease control occurs only in a subset of patients. Predicting progression-free survival (PFS) could support individualized treatment planning. This study evaluates laboratory, imaging, and multimodal deep learning models for PFS prediction in PRRT-treated patients. In this retrospective, single-center study 116 patients with metastatic NETs undergoing 177Lu-DOTATOC were included. Clinical characteristics, laboratory values, and pretherapeutic somatostatin receptor positron emission tomography/computed tomographies (SR-PET/CT) were collected. Seven models were trained to classify low- vs. high-PFS groups, including unimodal (laboratory, SR-PET, or CT) and multimodal fusion approaches. Explainability was evaluated by feature importance analysis and gradient maps. Forty-two patients (36%) had short PFS (< 1 year), 74 patients long PFS (>1 year). Groups were similar in most characteristics, except for higher baseline chromogranin A (p = 0.003), elevated gamma-GT (p = 0.002), and fewer PRRT cycles (p < 0.001) in short-PFS patients. The Random Forest model trained only on laboratory biomarkers reached an AUROC of 0.59 +- 0.02. Unimodal three-dimensional convolutional neural networks using SR-PET or CT performed worse (AUROC 0.42 +- 0.03 and 0.54 +- 0.01, respectively). A multimodal fusion model laboratory values, SR-PET, and CT -augmented with a pretrained CT branch - achieved the best results (AUROC 0.72 +- 0.01, AUPRC 0.80 +- 0.01). Multimodal deep learning combining SR-PET, CT, and laboratory biomarkers outperformed unimodal approaches for PFS prediction after PRRT. Upon external validation, such models may support risk-adapted follow-up strategies.
title Multimodal Deep Learning for Prediction of Progression-Free Survival in Patients with Neuroendocrine Tumors Undergoing 177Lu-based Peptide Receptor Radionuclide Therapy
topic Machine Learning
url https://arxiv.org/abs/2511.05169