Longitudinal Segmentation of MS Lesions via Temporal Difference Weighting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Rokuss, Maximilian, Kirchhoff, Yannick, Roy, Saikat, Kovacs, Balint, Ulrich, Constantin, Wald, Tassilo, Zenk, Maximilian, Denner, Stefan, Isensee, Fabian, Vollmuth, Philipp, Kleesiek, Jens, Maier-Hein, Klaus
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914953564258304
author Rokuss, Maximilian
Kirchhoff, Yannick
Roy, Saikat
Kovacs, Balint
Ulrich, Constantin
Wald, Tassilo
Zenk, Maximilian
Denner, Stefan
Isensee, Fabian
Vollmuth, Philipp
Kleesiek, Jens
Maier-Hein, Klaus
author_facet Rokuss, Maximilian
Kirchhoff, Yannick
Roy, Saikat
Kovacs, Balint
Ulrich, Constantin
Wald, Tassilo
Zenk, Maximilian
Denner, Stefan
Isensee, Fabian
Vollmuth, Philipp
Kleesiek, Jens
Maier-Hein, Klaus
contents Accurate segmentation of Multiple Sclerosis (MS) lesions in longitudinal MRI scans is crucial for monitoring disease progression and treatment efficacy. Although changes across time are taken into account when assessing images in clinical practice, most existing deep learning methods treat scans from different timepoints separately. Among studies utilizing longitudinal images, a simple channel-wise concatenation is the primary albeit suboptimal method employed to integrate timepoints. We introduce a novel approach that explicitly incorporates temporal differences between baseline and follow-up scans through a unique architectural inductive bias called Difference Weighting Block. It merges features from two timepoints, emphasizing changes between scans. We achieve superior scores in lesion segmentation (Dice Score, Hausdorff distance) as well as lesion detection (lesion-level $F_1$ score) as compared to state-of-the-art longitudinal and single timepoint models across two datasets. Our code is made publicly available at www.github.com/MIC-DKFZ/Longitudinal-Difference-Weighting.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13416
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Longitudinal Segmentation of MS Lesions via Temporal Difference Weighting
Rokuss, Maximilian
Kirchhoff, Yannick
Roy, Saikat
Kovacs, Balint
Ulrich, Constantin
Wald, Tassilo
Zenk, Maximilian
Denner, Stefan
Isensee, Fabian
Vollmuth, Philipp
Kleesiek, Jens
Maier-Hein, Klaus
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Accurate segmentation of Multiple Sclerosis (MS) lesions in longitudinal MRI scans is crucial for monitoring disease progression and treatment efficacy. Although changes across time are taken into account when assessing images in clinical practice, most existing deep learning methods treat scans from different timepoints separately. Among studies utilizing longitudinal images, a simple channel-wise concatenation is the primary albeit suboptimal method employed to integrate timepoints. We introduce a novel approach that explicitly incorporates temporal differences between baseline and follow-up scans through a unique architectural inductive bias called Difference Weighting Block. It merges features from two timepoints, emphasizing changes between scans. We achieve superior scores in lesion segmentation (Dice Score, Hausdorff distance) as well as lesion detection (lesion-level $F_1$ score) as compared to state-of-the-art longitudinal and single timepoint models across two datasets. Our code is made publicly available at www.github.com/MIC-DKFZ/Longitudinal-Difference-Weighting.
title Longitudinal Segmentation of MS Lesions via Temporal Difference Weighting
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2409.13416