Saved in:
Bibliographic Details
Main Authors: Yang, Zekang, Liu, Hong, Wang, Xiangdong
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.02145
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916380668854272
author Yang, Zekang
Liu, Hong
Wang, Xiangdong
author_facet Yang, Zekang
Liu, Hong
Wang, Xiangdong
contents Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as pathological images, genomic data and etc. In this paper, we propose a new training method, multimodal object-level contrast learning, for cancer survival risk prediction. First, we construct contrast learning pairs based on the survival risk relationship among the samples in the training sample set. Then we introduce the object-level contrast learning method to train the survival risk predictor. We further extend it to the multimodal scenario by applying cross-modal constrast. Considering the heterogeneity of pathological images and genomics data, we construct a multimodal survival risk predictor employing attention-based and self-normalizing based nerural network respectively. Finally, the survival risk predictor trained by our proposed method outperforms state-of-the-art methods on two public multimodal cancer datasets for survival risk prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2409_02145
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Multimodal Object-level Contrast Learning Method for Cancer Survival Risk Prediction
Yang, Zekang
Liu, Hong
Wang, Xiangdong
Machine Learning
Artificial Intelligence
Computer-aided cancer survival risk prediction plays an important role in the timely treatment of patients. This is a challenging weakly supervised ordinal regression task associated with multiple clinical factors involved such as pathological images, genomic data and etc. In this paper, we propose a new training method, multimodal object-level contrast learning, for cancer survival risk prediction. First, we construct contrast learning pairs based on the survival risk relationship among the samples in the training sample set. Then we introduce the object-level contrast learning method to train the survival risk predictor. We further extend it to the multimodal scenario by applying cross-modal constrast. Considering the heterogeneity of pathological images and genomics data, we construct a multimodal survival risk predictor employing attention-based and self-normalizing based nerural network respectively. Finally, the survival risk predictor trained by our proposed method outperforms state-of-the-art methods on two public multimodal cancer datasets for survival risk prediction.
title A Multimodal Object-level Contrast Learning Method for Cancer Survival Risk Prediction
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2409.02145