Saved in:
Bibliographic Details
Main Authors: Ibañez, Victor, Szostak, Przemyslaw, Wong, Quincy, Korski, Konstanty, Abbasi-Sureshjani, Samaneh, Gomariz, Alvaro
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.15068
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914724773363712
author Ibañez, Victor
Szostak, Przemyslaw
Wong, Quincy
Korski, Konstanty
Abbasi-Sureshjani, Samaneh
Gomariz, Alvaro
author_facet Ibañez, Victor
Szostak, Przemyslaw
Wong, Quincy
Korski, Konstanty
Abbasi-Sureshjani, Samaneh
Gomariz, Alvaro
contents Graph convolutional networks (GCNs) have emerged as a powerful alternative to multiple instance learning with convolutional neural networks in digital pathology, offering superior handling of structural information across various spatial ranges - a crucial aspect of learning from gigapixel H&E-stained whole slide images (WSI). However, graph message-passing algorithms often suffer from oversmoothing when aggregating a large neighborhood. Hence, effective modeling of multi-range interactions relies on the careful construction of the graph. Our proposed multi-scale GCN (MS-GCN) tackles this issue by leveraging information across multiple magnification levels in WSIs. MS-GCN enables the simultaneous modeling of long-range structural dependencies at lower magnifications and high-resolution cellular details at higher magnifications, akin to analysis pipelines usually conducted by pathologists. The architecture's unique configuration allows for the concurrent modeling of structural patterns at lower magnifications and detailed cellular features at higher ones, while also quantifying the contribution of each magnification level to the prediction. Through testing on different datasets, MS-GCN demonstrates superior performance over existing single-magnification GCN methods. The enhancement in performance and interpretability afforded by our method holds promise for advancing computational pathology models, especially in tasks requiring extensive spatial context.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15068
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integrating multiscale topology in digital pathology with pyramidal graph convolutional networks
Ibañez, Victor
Szostak, Przemyslaw
Wong, Quincy
Korski, Konstanty
Abbasi-Sureshjani, Samaneh
Gomariz, Alvaro
Image and Video Processing
Computer Vision and Pattern Recognition
Graph convolutional networks (GCNs) have emerged as a powerful alternative to multiple instance learning with convolutional neural networks in digital pathology, offering superior handling of structural information across various spatial ranges - a crucial aspect of learning from gigapixel H&E-stained whole slide images (WSI). However, graph message-passing algorithms often suffer from oversmoothing when aggregating a large neighborhood. Hence, effective modeling of multi-range interactions relies on the careful construction of the graph. Our proposed multi-scale GCN (MS-GCN) tackles this issue by leveraging information across multiple magnification levels in WSIs. MS-GCN enables the simultaneous modeling of long-range structural dependencies at lower magnifications and high-resolution cellular details at higher magnifications, akin to analysis pipelines usually conducted by pathologists. The architecture's unique configuration allows for the concurrent modeling of structural patterns at lower magnifications and detailed cellular features at higher ones, while also quantifying the contribution of each magnification level to the prediction. Through testing on different datasets, MS-GCN demonstrates superior performance over existing single-magnification GCN methods. The enhancement in performance and interpretability afforded by our method holds promise for advancing computational pathology models, especially in tasks requiring extensive spatial context.
title Integrating multiscale topology in digital pathology with pyramidal graph convolutional networks
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.15068