RudolfV: A Foundation Model by Pathologists for Pathologists
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929381462507520 |
|---|---|
| author | Dippel, Jonas Feulner, Barbara Winterhoff, Tobias Milbich, Timo Tietz, Stephan Schallenberg, Simon Dernbach, Gabriel Kunft, Andreas Heinke, Simon Eich, Marie-Lisa Ribbat-Idel, Julika Krupar, Rosemarie Anders, Philipp Prenißl, Niklas Jurmeister, Philipp Horst, David Ruff, Lukas Müller, Klaus-Robert Klauschen, Frederick Alber, Maximilian |
| author_facet | Dippel, Jonas Feulner, Barbara Winterhoff, Tobias Milbich, Timo Tietz, Stephan Schallenberg, Simon Dernbach, Gabriel Kunft, Andreas Heinke, Simon Eich, Marie-Lisa Ribbat-Idel, Julika Krupar, Rosemarie Anders, Philipp Prenißl, Niklas Jurmeister, Philipp Horst, David Ruff, Lukas Müller, Klaus-Robert Klauschen, Frederick Alber, Maximilian |
| contents | Artificial intelligence has started to transform histopathology impacting clinical diagnostics and biomedical research. However, while many computational pathology approaches have been proposed, most current AI models are limited with respect to generalization, application variety, and handling rare diseases. Recent efforts introduced self-supervised foundation models to address these challenges, yet existing approaches do not leverage pathologist knowledge by design. In this study, we present a novel approach to designing foundation models for computational pathology, incorporating pathologist expertise, semi-automated data curation, and a diverse dataset from over 15 laboratories, including 58 tissue types, and encompassing 129 different histochemical and immunohistochemical staining modalities. We demonstrate that our model "RudolfV" surpasses existing state-of-the-art foundation models across different benchmarks focused on tumor microenvironment profiling, biomarker evaluation, and reference case search while exhibiting favorable robustness properties. Our study shows how domain-specific knowledge can increase the efficiency and performance of pathology foundation models and enable novel application areas. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04079 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RudolfV: A Foundation Model by Pathologists for Pathologists Dippel, Jonas Feulner, Barbara Winterhoff, Tobias Milbich, Timo Tietz, Stephan Schallenberg, Simon Dernbach, Gabriel Kunft, Andreas Heinke, Simon Eich, Marie-Lisa Ribbat-Idel, Julika Krupar, Rosemarie Anders, Philipp Prenißl, Niklas Jurmeister, Philipp Horst, David Ruff, Lukas Müller, Klaus-Robert Klauschen, Frederick Alber, Maximilian Image and Video Processing Computer Vision and Pattern Recognition Machine Learning Artificial intelligence has started to transform histopathology impacting clinical diagnostics and biomedical research. However, while many computational pathology approaches have been proposed, most current AI models are limited with respect to generalization, application variety, and handling rare diseases. Recent efforts introduced self-supervised foundation models to address these challenges, yet existing approaches do not leverage pathologist knowledge by design. In this study, we present a novel approach to designing foundation models for computational pathology, incorporating pathologist expertise, semi-automated data curation, and a diverse dataset from over 15 laboratories, including 58 tissue types, and encompassing 129 different histochemical and immunohistochemical staining modalities. We demonstrate that our model "RudolfV" surpasses existing state-of-the-art foundation models across different benchmarks focused on tumor microenvironment profiling, biomarker evaluation, and reference case search while exhibiting favorable robustness properties. Our study shows how domain-specific knowledge can increase the efficiency and performance of pathology foundation models and enable novel application areas. |
| title | RudolfV: A Foundation Model by Pathologists for Pathologists |
| topic | Image and Video Processing Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2401.04079 |