Saved in:
Bibliographic Details
Main Authors: Wang, Jun, Mao, Yu, Cui, Yufei, Guan, Nan, Xue, Chun Jason
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.08197
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929343252398080
author Wang, Jun
Mao, Yu
Cui, Yufei
Guan, Nan
Xue, Chun Jason
author_facet Wang, Jun
Mao, Yu
Cui, Yufei
Guan, Nan
Xue, Chun Jason
contents Immunohistochemistry (IHC) plays a crucial role in pathology as it detects the over-expression of protein in tissue samples. However, there are still fewer machine learning model studies on IHC's impact on accurate cancer grading. We discovered that IHC and H\&E possess distinct advantages and disadvantages while possessing certain complementary qualities. Building on this observation, we developed a two-stage multi-modal bilinear model with a feature pooling module. This model aims to maximize the potential of both IHC and HE's feature representation, resulting in improved performance compared to their individual use. Our experiments demonstrate that incorporating IHC data into machine learning models, alongside H\&E stained images, leads to superior predictive results for cancer grading. The proposed framework achieves an impressive ACC higher of 0.953 on the public dataset BCI.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08197
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle IHC Matters: Incorporating IHC analysis to H&E Whole Slide Image Analysis for Improved Cancer Grading via Two-stage Multimodal Bilinear Pooling Fusion
Wang, Jun
Mao, Yu
Cui, Yufei
Guan, Nan
Xue, Chun Jason
Computer Vision and Pattern Recognition
Immunohistochemistry (IHC) plays a crucial role in pathology as it detects the over-expression of protein in tissue samples. However, there are still fewer machine learning model studies on IHC's impact on accurate cancer grading. We discovered that IHC and H\&E possess distinct advantages and disadvantages while possessing certain complementary qualities. Building on this observation, we developed a two-stage multi-modal bilinear model with a feature pooling module. This model aims to maximize the potential of both IHC and HE's feature representation, resulting in improved performance compared to their individual use. Our experiments demonstrate that incorporating IHC data into machine learning models, alongside H\&E stained images, leads to superior predictive results for cancer grading. The proposed framework achieves an impressive ACC higher of 0.953 on the public dataset BCI.
title IHC Matters: Incorporating IHC analysis to H&E Whole Slide Image Analysis for Improved Cancer Grading via Two-stage Multimodal Bilinear Pooling Fusion
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.08197