Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fuster, Saul, Khoraminia, Farbod, Silva-Rodríguez, Julio, Kiraz, Umay, van Leenders, Geert J. L. H., Eftestøl, Trygve, Naranjo, Valery, Janssen, Emiel A. M., Zuiverloon, Tahlita C. M., Engan, Kjersti
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911191329144832
author Fuster, Saul
Khoraminia, Farbod
Silva-Rodríguez, Julio
Kiraz, Umay
van Leenders, Geert J. L. H.
Eftestøl, Trygve
Naranjo, Valery
Janssen, Emiel A. M.
Zuiverloon, Tahlita C. M.
Engan, Kjersti
author_facet Fuster, Saul
Khoraminia, Farbod
Silva-Rodríguez, Julio
Kiraz, Umay
van Leenders, Geert J. L. H.
Eftestøl, Trygve
Naranjo, Valery
Janssen, Emiel A. M.
Zuiverloon, Tahlita C. M.
Engan, Kjersti
contents We present a pioneering investigation into the application of deep learning techniques to analyze histopathological images for addressing the substantial challenge of automated prognostic prediction. Prognostic prediction poses a unique challenge as the ground truth labels are inherently weak, and the model must anticipate future events that are not directly observable in the image. To address this challenge, we propose a novel three-part framework comprising of a convolutional network based tissue segmentation algorithm for region of interest delineation, a contrastive learning module for feature extraction, and a nested multiple instance learning classification module. Our study explores the significance of various regions of interest within the histopathological slides and exploits diverse learning scenarios. The pipeline is initially validated on artificially generated data and a simpler diagnostic task. Transitioning to prognostic prediction, tasks become more challenging. Employing bladder cancer as use case, our best models yield an AUC of 0.721 and 0.678 for recurrence and treatment outcome prediction respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2405_15264
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images
Fuster, Saul
Khoraminia, Farbod
Silva-Rodríguez, Julio
Kiraz, Umay
van Leenders, Geert J. L. H.
Eftestøl, Trygve
Naranjo, Valery
Janssen, Emiel A. M.
Zuiverloon, Tahlita C. M.
Engan, Kjersti
Computer Vision and Pattern Recognition
Artificial Intelligence
We present a pioneering investigation into the application of deep learning techniques to analyze histopathological images for addressing the substantial challenge of automated prognostic prediction. Prognostic prediction poses a unique challenge as the ground truth labels are inherently weak, and the model must anticipate future events that are not directly observable in the image. To address this challenge, we propose a novel three-part framework comprising of a convolutional network based tissue segmentation algorithm for region of interest delineation, a contrastive learning module for feature extraction, and a nested multiple instance learning classification module. Our study explores the significance of various regions of interest within the histopathological slides and exploits diverse learning scenarios. The pipeline is initially validated on artificially generated data and a simpler diagnostic task. Transitioning to prognostic prediction, tasks become more challenging. Employing bladder cancer as use case, our best models yield an AUC of 0.721 and 0.678 for recurrence and treatment outcome prediction respectively.
title Self-Contrastive Weakly Supervised Learning Framework for Prognostic Prediction Using Whole Slide Images
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2405.15264