Exploiting Longitudinal Context in Clinician-Verified Interactive Lesion Tracking

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kirchhoff, Yannick, Rokuss, Maximilian, Mertens, Daniel Philipp, Füller, David, Hamm, Benjamin, Schreyer, Andreas, Ritter, Oliver, Maier-Hein, Klaus
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914590619598848
author Kirchhoff, Yannick
Rokuss, Maximilian
Mertens, Daniel Philipp
Füller, David
Hamm, Benjamin
Schreyer, Andreas
Ritter, Oliver
Maier-Hein, Klaus
author_facet Kirchhoff, Yannick
Rokuss, Maximilian
Mertens, Daniel Philipp
Füller, David
Hamm, Benjamin
Schreyer, Andreas
Ritter, Oliver
Maier-Hein, Klaus
contents Tracking tumor lesions across serial CT scans is essential for oncological response assessment. Existing automated methods face a fundamental trade-off: end-to-end trackers achieve high automation but offer no opportunity to correct silent tracking failures, while decoupled registration-segmentation pipelines permit user verification yet discard the lesion's prior appearance, limiting accuracy in ambiguous cases. In this work, we propose a Verified Tracking paradigm: a clinician verifies a registration-proposed prompt, which the model leverages alongside the baseline lesion appearance to resolve segmentation ambiguities. We present a unified framework combining early spatial prompt fusion with latent temporal difference weighting for longitudinally-informed segmentation. To address data scarcity, we leverage large-scale synthetic pretraining, proving essential for exploiting longitudinal context, improving performance by up to 4.5 Dice points over training from scratch. Our approach secured first place in the MICCAI autoPET IV challenge. We further curate and release PanTrack, a new longitudinal pancreatic cancer benchmark, to assess out-of-distribution generalization. Experiments show that our model outperforms prior work in both fully automatic and the proposed verified tracking setting offering a clinically safe middle ground between automation and control. Code, model and dataset will be released at https://github.com/MIC-DKFZ/LongiSeg
format Preprint
id arxiv_https___arxiv_org_abs_2605_23118
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Exploiting Longitudinal Context in Clinician-Verified Interactive Lesion Tracking
Kirchhoff, Yannick
Rokuss, Maximilian
Mertens, Daniel Philipp
Füller, David
Hamm, Benjamin
Schreyer, Andreas
Ritter, Oliver
Maier-Hein, Klaus
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Tracking tumor lesions across serial CT scans is essential for oncological response assessment. Existing automated methods face a fundamental trade-off: end-to-end trackers achieve high automation but offer no opportunity to correct silent tracking failures, while decoupled registration-segmentation pipelines permit user verification yet discard the lesion's prior appearance, limiting accuracy in ambiguous cases. In this work, we propose a Verified Tracking paradigm: a clinician verifies a registration-proposed prompt, which the model leverages alongside the baseline lesion appearance to resolve segmentation ambiguities. We present a unified framework combining early spatial prompt fusion with latent temporal difference weighting for longitudinally-informed segmentation. To address data scarcity, we leverage large-scale synthetic pretraining, proving essential for exploiting longitudinal context, improving performance by up to 4.5 Dice points over training from scratch. Our approach secured first place in the MICCAI autoPET IV challenge. We further curate and release PanTrack, a new longitudinal pancreatic cancer benchmark, to assess out-of-distribution generalization. Experiments show that our model outperforms prior work in both fully automatic and the proposed verified tracking setting offering a clinically safe middle ground between automation and control. Code, model and dataset will be released at https://github.com/MIC-DKFZ/LongiSeg
title Exploiting Longitudinal Context in Clinician-Verified Interactive Lesion Tracking
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2605.23118