Predicting ulcer in H&E images of inflammatory bowel disease using domain-knowledge-driven graph neural network

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ding, Ruiwen, Li, Lin, Soans, Rajath, Shah, Tosha, Krishnan, Radha, Sze, Marc Alexander, Lukyanov, Sasha, Deshpande, Yash, Chen, Antong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917984289685504
author Ding, Ruiwen
Li, Lin
Soans, Rajath
Shah, Tosha
Krishnan, Radha
Sze, Marc Alexander
Lukyanov, Sasha
Deshpande, Yash
Chen, Antong
author_facet Ding, Ruiwen
Li, Lin
Soans, Rajath
Shah, Tosha
Krishnan, Radha
Sze, Marc Alexander
Lukyanov, Sasha
Deshpande, Yash
Chen, Antong
contents Inflammatory bowel disease (IBD) involves chronic inflammation of the digestive tract, with treatment options often burdened by adverse effects. Identifying biomarkers for personalized treatment is crucial. While immune cells play a key role in IBD, accurately identifying ulcer regions in whole slide images (WSIs) is essential for characterizing these cells and exploring potential therapeutics. Multiple instance learning (MIL) approaches have advanced WSI analysis but they lack spatial context awareness. In this work, we propose a weakly-supervised model called DomainGCN that employs a graph convolution neural network (GCN) and incorporates domain-specific knowledge of ulcer features, specifically, the presence of epithelium, lymphocytes, and debris for WSI-level ulcer prediction in IBD. We demonstrate that DomainGCN outperforms various state-of-the-art (SOTA) MIL methods and show the added value of domain knowledge.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09430
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Predicting ulcer in H&E images of inflammatory bowel disease using domain-knowledge-driven graph neural network
Ding, Ruiwen
Li, Lin
Soans, Rajath
Shah, Tosha
Krishnan, Radha
Sze, Marc Alexander
Lukyanov, Sasha
Deshpande, Yash
Chen, Antong
Image and Video Processing
Computer Vision and Pattern Recognition
Inflammatory bowel disease (IBD) involves chronic inflammation of the digestive tract, with treatment options often burdened by adverse effects. Identifying biomarkers for personalized treatment is crucial. While immune cells play a key role in IBD, accurately identifying ulcer regions in whole slide images (WSIs) is essential for characterizing these cells and exploring potential therapeutics. Multiple instance learning (MIL) approaches have advanced WSI analysis but they lack spatial context awareness. In this work, we propose a weakly-supervised model called DomainGCN that employs a graph convolution neural network (GCN) and incorporates domain-specific knowledge of ulcer features, specifically, the presence of epithelium, lymphocytes, and debris for WSI-level ulcer prediction in IBD. We demonstrate that DomainGCN outperforms various state-of-the-art (SOTA) MIL methods and show the added value of domain knowledge.
title Predicting ulcer in H&E images of inflammatory bowel disease using domain-knowledge-driven graph neural network
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.09430