Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shu, Chen, Fu, Boyu, Li, Yiman, Yin, Ting, Zhang, Wenchuan, Chen, Jie, Yi, Yuhao, Bu, Hong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916761511657472
author Shu, Chen
Fu, Boyu
Li, Yiman
Yin, Ting
Zhang, Wenchuan
Chen, Jie
Yi, Yuhao
Bu, Hong
author_facet Shu, Chen
Fu, Boyu
Li, Yiman
Yin, Ting
Zhang, Wenchuan
Chen, Jie
Yi, Yuhao
Bu, Hong
contents Multiple Instance Learning is the predominant method for Whole Slide Image classification in digital pathology, enabling the use of slide-level labels to supervise model training. Although MIL eliminates the tedious fine-grained annotation process for supervised learning, whether it can learn accurate bag- and instance-level classifiers remains a question. To address the issue, instance-level classifiers and instance masks were incorporated to ground the prediction on supporting patches. These methods, while practically improving the performance of MIL methods, may potentially introduce noisy labels. We propose to bridge the gap between commonly used MIL and fully supervised learning by augmenting both the bag- and instance-level learning processes with pseudo-label correction capabilities elicited from weak to strong generalization techniques. The proposed algorithm improves the performance of dual-level MIL algorithms on both bag- and instance-level predictions. Experiments on public pathology datasets showcase the advantage of the proposed methods.
format Preprint
id arxiv_https___arxiv_org_abs_2505_12074
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
Shu, Chen
Fu, Boyu
Li, Yiman
Yin, Ting
Zhang, Wenchuan
Chen, Jie
Yi, Yuhao
Bu, Hong
Computer Vision and Pattern Recognition
Multiple Instance Learning is the predominant method for Whole Slide Image classification in digital pathology, enabling the use of slide-level labels to supervise model training. Although MIL eliminates the tedious fine-grained annotation process for supervised learning, whether it can learn accurate bag- and instance-level classifiers remains a question. To address the issue, instance-level classifiers and instance masks were incorporated to ground the prediction on supporting patches. These methods, while practically improving the performance of MIL methods, may potentially introduce noisy labels. We propose to bridge the gap between commonly used MIL and fully supervised learning by augmenting both the bag- and instance-level learning processes with pseudo-label correction capabilities elicited from weak to strong generalization techniques. The proposed algorithm improves the performance of dual-level MIL algorithms on both bag- and instance-level predictions. Experiments on public pathology datasets showcase the advantage of the proposed methods.
title Denoising Mutual Knowledge Distillation in Bi-Directional Multiple Instance Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.12074