Towards Robust Foundation Models for Digital Pathology

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kömen, Jonah, de Jong, Edwin D., Hense, Julius, Marienwald, Hannah, Dippel, Jonas, Naumann, Philip, Marcus, Eric, Ruff, Lukas, Alber, Maximilian, Teuwen, Jonas, Klauschen, Frederick, Müller, Klaus-Robert
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911073929527296
author Kömen, Jonah
de Jong, Edwin D.
Hense, Julius
Marienwald, Hannah
Dippel, Jonas
Naumann, Philip
Marcus, Eric
Ruff, Lukas
Alber, Maximilian
Teuwen, Jonas
Klauschen, Frederick
Müller, Klaus-Robert
author_facet Kömen, Jonah
de Jong, Edwin D.
Hense, Julius
Marienwald, Hannah
Dippel, Jonas
Naumann, Philip
Marcus, Eric
Ruff, Lukas
Alber, Maximilian
Teuwen, Jonas
Klauschen, Frederick
Müller, Klaus-Robert
contents Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in surgical/endoscopic techniques, laboratory procedures, and scanner hardware -- poses risks for clinical deployment. We present the first systematic investigation of pathology FM robustness to non-biological features. Our work (i) introduces measures to quantify FM robustness, (ii) demonstrates the consequences of limited robustness, and (iii) proposes a framework for FM robustification to mitigate these issues. Specifically, we developed PathoROB, a robustness benchmark with three novel metrics, including the robustness index, and four datasets covering 28 biological classes from 34 medical centers. Our experiments reveal robustness deficits across all 20 evaluated FMs, and substantial robustness differences between them. We found that non-robust FM representations can cause major diagnostic downstream errors and clinical blunders that prevent safe clinical adoption. Using more robust FMs and post-hoc robustification considerably reduced (but did not yet eliminate) the risk of such errors. This work establishes that robustness evaluation is essential for validating pathology FMs before clinical adoption and demonstrates that future FM development must integrate robustness as a core design principle. PathoROB provides a blueprint for assessing robustness across biomedical domains, guiding FM improvement efforts towards more robust, representative, and clinically deployable AI systems that prioritize biological information over technical artifacts.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17845
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Robust Foundation Models for Digital Pathology
Kömen, Jonah
de Jong, Edwin D.
Hense, Julius
Marienwald, Hannah
Dippel, Jonas
Naumann, Philip
Marcus, Eric
Ruff, Lukas
Alber, Maximilian
Teuwen, Jonas
Klauschen, Frederick
Müller, Klaus-Robert
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Quantitative Methods
Biomedical Foundation Models (FMs) are rapidly transforming AI-enabled healthcare research and entering clinical validation. However, their susceptibility to learning non-biological technical features -- including variations in surgical/endoscopic techniques, laboratory procedures, and scanner hardware -- poses risks for clinical deployment. We present the first systematic investigation of pathology FM robustness to non-biological features. Our work (i) introduces measures to quantify FM robustness, (ii) demonstrates the consequences of limited robustness, and (iii) proposes a framework for FM robustification to mitigate these issues. Specifically, we developed PathoROB, a robustness benchmark with three novel metrics, including the robustness index, and four datasets covering 28 biological classes from 34 medical centers. Our experiments reveal robustness deficits across all 20 evaluated FMs, and substantial robustness differences between them. We found that non-robust FM representations can cause major diagnostic downstream errors and clinical blunders that prevent safe clinical adoption. Using more robust FMs and post-hoc robustification considerably reduced (but did not yet eliminate) the risk of such errors. This work establishes that robustness evaluation is essential for validating pathology FMs before clinical adoption and demonstrates that future FM development must integrate robustness as a core design principle. PathoROB provides a blueprint for assessing robustness across biomedical domains, guiding FM improvement efforts towards more robust, representative, and clinically deployable AI systems that prioritize biological information over technical artifacts.
title Towards Robust Foundation Models for Digital Pathology
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2507.17845