Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909312679411712 |
|---|---|
| author | Alfasly, Saghir Alabtah, Ghazal Hemati, Sobhan Kalari, Krishna Rani Tizhoosh, H. R. |
| author_facet | Alfasly, Saghir Alabtah, Ghazal Hemati, Sobhan Kalari, Krishna Rani Tizhoosh, H. R. |
| contents | We have tested recently published foundation models for histopathology for image retrieval. We report macro average of F1 score for top-1 retrieval, majority of top-3 retrievals, and majority of top-5 retrievals. We perform zero-shot retrievals, i.e., we do not alter embeddings and we do not train any classifier. As test data, we used diagnostic slides of TCGA, The Cancer Genome Atlas, consisting of 23 organs and 117 cancer subtypes. As a search platform we used Yottixel that enabled us to perform WSI search using patches. Achieved F1 scores show low performance, e.g., for top-5 retrievals, 27% +/- 13% (Yottixel-DenseNet), 42% +/- 14% (Yottixel-UNI), 40%+/-13% (Yottixel-Virchow), 41%+/-13% (Yottixel-GigaPath), and 41%+/-14% (GigaPath WSI). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04631 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Models Alfasly, Saghir Alabtah, Ghazal Hemati, Sobhan Kalari, Krishna Rani Tizhoosh, H. R. Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition We have tested recently published foundation models for histopathology for image retrieval. We report macro average of F1 score for top-1 retrieval, majority of top-3 retrievals, and majority of top-5 retrievals. We perform zero-shot retrievals, i.e., we do not alter embeddings and we do not train any classifier. As test data, we used diagnostic slides of TCGA, The Cancer Genome Atlas, consisting of 23 organs and 117 cancer subtypes. As a search platform we used Yottixel that enabled us to perform WSI search using patches. Achieved F1 scores show low performance, e.g., for top-5 retrievals, 27% +/- 13% (Yottixel-DenseNet), 42% +/- 14% (Yottixel-UNI), 40%+/-13% (Yottixel-Virchow), 41%+/-13% (Yottixel-GigaPath), and 41%+/-14% (GigaPath WSI). |
| title | Zero-Shot Whole Slide Image Retrieval in Histopathology Using Embeddings of Foundation Models |
| topic | Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.04631 |