Probabilistic smooth attention for deep multiple instance learning in medical imaging

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Castro-Macías, Francisco M., Morales-Álvarez, Pablo, Wu, Yunan, Molina, Rafael, Katsaggelos, Aggelos K.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913950128406528
author Castro-Macías, Francisco M.
Morales-Álvarez, Pablo
Wu, Yunan
Molina, Rafael
Katsaggelos, Aggelos K.
author_facet Castro-Macías, Francisco M.
Morales-Álvarez, Pablo
Wu, Yunan
Molina, Rafael
Katsaggelos, Aggelos K.
contents The Multiple Instance Learning (MIL) paradigm is attracting plenty of attention in medical imaging classification, where labeled data is scarce. MIL methods cast medical images as bags of instances (e.g. patches in whole slide images, or slices in CT scans), and only bag labels are required for training. Deep MIL approaches have obtained promising results by aggregating instance-level representations via an attention mechanism to compute the bag-level prediction. These methods typically capture both local interactions among adjacent instances and global, long-range dependencies through various mechanisms. However, they treat attention values deterministically, potentially overlooking uncertainty in the contribution of individual instances. In this work we propose a novel probabilistic framework that estimates a probability distribution over the attention values, and accounts for both global and local interactions. In a comprehensive evaluation involving {\color{review} eleven} state-of-the-art baselines and three medical datasets, we show that our approach achieves top predictive performance in different metrics. Moreover, the probabilistic treatment of the attention provides uncertainty maps that are interpretable in terms of illness localization.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14932
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Probabilistic smooth attention for deep multiple instance learning in medical imaging
Castro-Macías, Francisco M.
Morales-Álvarez, Pablo
Wu, Yunan
Molina, Rafael
Katsaggelos, Aggelos K.
Computer Vision and Pattern Recognition
The Multiple Instance Learning (MIL) paradigm is attracting plenty of attention in medical imaging classification, where labeled data is scarce. MIL methods cast medical images as bags of instances (e.g. patches in whole slide images, or slices in CT scans), and only bag labels are required for training. Deep MIL approaches have obtained promising results by aggregating instance-level representations via an attention mechanism to compute the bag-level prediction. These methods typically capture both local interactions among adjacent instances and global, long-range dependencies through various mechanisms. However, they treat attention values deterministically, potentially overlooking uncertainty in the contribution of individual instances. In this work we propose a novel probabilistic framework that estimates a probability distribution over the attention values, and accounts for both global and local interactions. In a comprehensive evaluation involving {\color{review} eleven} state-of-the-art baselines and three medical datasets, we show that our approach achieves top predictive performance in different metrics. Moreover, the probabilistic treatment of the attention provides uncertainty maps that are interpretable in terms of illness localization.
title Probabilistic smooth attention for deep multiple instance learning in medical imaging
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.14932