Synthetic Data Reveals Generalization Gaps in Correlated Multiple Instance Learning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Harvey, Ethan, Loevlie, Dennis Johan, Hughes, Michael C.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914152554954752
author Harvey, Ethan
Loevlie, Dennis Johan
Hughes, Michael C.
author_facet Harvey, Ethan
Loevlie, Dennis Johan
Hughes, Michael C.
contents Multiple instance learning (MIL) is often used in medical imaging to classify high-resolution 2D images by processing patches or classify 3D volumes by processing slices. However, conventional MIL approaches treat instances separately, ignoring contextual relationships such as the appearance of nearby patches or slices that can be essential in real applications. We design a synthetic classification task where accounting for adjacent instance features is crucial for accurate prediction. We demonstrate the limitations of off-the-shelf MIL approaches by quantifying their performance compared to the optimal Bayes estimator for this task, which is available in closed-form. We empirically show that newer correlated MIL methods still do not achieve the best possible performance when trained with ten thousand training samples, each containing many instances.
format Preprint
id arxiv_https___arxiv_org_abs_2510_25759
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Synthetic Data Reveals Generalization Gaps in Correlated Multiple Instance Learning
Harvey, Ethan
Loevlie, Dennis Johan
Hughes, Michael C.
Machine Learning
Multiple instance learning (MIL) is often used in medical imaging to classify high-resolution 2D images by processing patches or classify 3D volumes by processing slices. However, conventional MIL approaches treat instances separately, ignoring contextual relationships such as the appearance of nearby patches or slices that can be essential in real applications. We design a synthetic classification task where accounting for adjacent instance features is crucial for accurate prediction. We demonstrate the limitations of off-the-shelf MIL approaches by quantifying their performance compared to the optimal Bayes estimator for this task, which is available in closed-form. We empirically show that newer correlated MIL methods still do not achieve the best possible performance when trained with ten thousand training samples, each containing many instances.
title Synthetic Data Reveals Generalization Gaps in Correlated Multiple Instance Learning
topic Machine Learning
url https://arxiv.org/abs/2510.25759