Fourier Transform Multiple Instance Learning for Whole Slide Image Classification

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bilic, Anthony, Sun, Guangyu, Li, Ming, Hossain, Md Sanzid Bin, Tian, Yu, Zhang, Wei, Brattain, Laura, Hadley, Dexter, Chen, Chen
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909862162595840
author Bilic, Anthony
Sun, Guangyu
Li, Ming
Hossain, Md Sanzid Bin
Tian, Yu
Zhang, Wei
Brattain, Laura
Hadley, Dexter
Chen, Chen
author_facet Bilic, Anthony
Sun, Guangyu
Li, Ming
Hossain, Md Sanzid Bin
Tian, Yu
Zhang, Wei
Brattain, Laura
Hadley, Dexter
Chen, Chen
contents Whole Slide Image (WSI) classification relies on Multiple Instance Learning (MIL) with spatial patch features, yet existing methods struggle to capture global dependencies due to the immense size of WSIs and the local nature of patch embeddings. This limitation hinders the modeling of coarse structures essential for robust diagnostic prediction. We propose Fourier Transform Multiple Instance Learning (FFT-MIL), a framework that augments MIL with a frequency-domain branch to provide compact global context. Low-frequency crops are extracted from WSIs via the Fast Fourier Transform and processed through a modular FFT-Block composed of convolutional layers and Min-Max normalization to mitigate the high variance of frequency data. The learned global frequency feature is fused with spatial patch features through lightweight integration strategies, enabling compatibility with diverse MIL architectures. FFT-MIL was evaluated across six state-of-the-art MIL methods on three public datasets (BRACS, LUAD, and IMP). Integration of the FFT-Block improved macro F1 scores by an average of 3.51% and AUC by 1.51%, demonstrating consistent gains across architectures and datasets. These results establish frequency-domain learning as an effective and efficient mechanism for capturing global dependencies in WSI classification, complementing spatial features and advancing the scalability and accuracy of MIL-based computational pathology.
format Preprint
id arxiv_https___arxiv_org_abs_2510_15138
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fourier Transform Multiple Instance Learning for Whole Slide Image Classification
Bilic, Anthony
Sun, Guangyu
Li, Ming
Hossain, Md Sanzid Bin
Tian, Yu
Zhang, Wei
Brattain, Laura
Hadley, Dexter
Chen, Chen
Computer Vision and Pattern Recognition
Whole Slide Image (WSI) classification relies on Multiple Instance Learning (MIL) with spatial patch features, yet existing methods struggle to capture global dependencies due to the immense size of WSIs and the local nature of patch embeddings. This limitation hinders the modeling of coarse structures essential for robust diagnostic prediction. We propose Fourier Transform Multiple Instance Learning (FFT-MIL), a framework that augments MIL with a frequency-domain branch to provide compact global context. Low-frequency crops are extracted from WSIs via the Fast Fourier Transform and processed through a modular FFT-Block composed of convolutional layers and Min-Max normalization to mitigate the high variance of frequency data. The learned global frequency feature is fused with spatial patch features through lightweight integration strategies, enabling compatibility with diverse MIL architectures. FFT-MIL was evaluated across six state-of-the-art MIL methods on three public datasets (BRACS, LUAD, and IMP). Integration of the FFT-Block improved macro F1 scores by an average of 3.51% and AUC by 1.51%, demonstrating consistent gains across architectures and datasets. These results establish frequency-domain learning as an effective and efficient mechanism for capturing global dependencies in WSI classification, complementing spatial features and advancing the scalability and accuracy of MIL-based computational pathology.
title Fourier Transform Multiple Instance Learning for Whole Slide Image Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.15138