Multi-head Attention-based Deep Multiple Instance Learning

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Keshvarikhojasteh, Hassan, Pluim, Josien, Veta, Mitko
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916197637816320
author Keshvarikhojasteh, Hassan
Pluim, Josien
Veta, Mitko
author_facet Keshvarikhojasteh, Hassan
Pluim, Josien
Veta, Mitko
contents This paper introduces MAD-MIL, a Multi-head Attention-based Deep Multiple Instance Learning model, designed for weakly supervised Whole Slide Images (WSIs) classification in digital pathology. Inspired by the multi-head attention mechanism of the Transformer, MAD-MIL simplifies model complexity while achieving competitive results against advanced models like CLAM and DS-MIL. Evaluated on the MNIST-BAGS and public datasets, including TUPAC16, TCGA BRCA, TCGA LUNG, and TCGA KIDNEY, MAD-MIL consistently outperforms ABMIL. This demonstrates enhanced information diversity, interpretability, and efficiency in slide representation. The model's effectiveness, coupled with fewer trainable parameters and lower computational complexity makes it a promising solution for automated pathology workflows. Our code is available at https://github.com/tueimage/MAD-MIL.
format Preprint
id arxiv_https___arxiv_org_abs_2404_05362
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-head Attention-based Deep Multiple Instance Learning
Keshvarikhojasteh, Hassan
Pluim, Josien
Veta, Mitko
Computer Vision and Pattern Recognition
This paper introduces MAD-MIL, a Multi-head Attention-based Deep Multiple Instance Learning model, designed for weakly supervised Whole Slide Images (WSIs) classification in digital pathology. Inspired by the multi-head attention mechanism of the Transformer, MAD-MIL simplifies model complexity while achieving competitive results against advanced models like CLAM and DS-MIL. Evaluated on the MNIST-BAGS and public datasets, including TUPAC16, TCGA BRCA, TCGA LUNG, and TCGA KIDNEY, MAD-MIL consistently outperforms ABMIL. This demonstrates enhanced information diversity, interpretability, and efficiency in slide representation. The model's effectiveness, coupled with fewer trainable parameters and lower computational complexity makes it a promising solution for automated pathology workflows. Our code is available at https://github.com/tueimage/MAD-MIL.
title Multi-head Attention-based Deep Multiple Instance Learning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2404.05362