Glioma subtype classification from histopathological images using in-domain and out-of-domain transfer learning: An experimental study
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866911805117300736 |
|---|---|
| author | Despotovic, Vladimir Kim, Sang-Yoon Hau, Ann-Christin Kakoichankava, Aliaksandra Klamminger, Gilbert Georg Borgmann, Felix Bruno Kleine Frauenknecht, Katrin B. M. Mittelbronn, Michel Nazarov, Petr V. |
| author_facet | Despotovic, Vladimir Kim, Sang-Yoon Hau, Ann-Christin Kakoichankava, Aliaksandra Klamminger, Gilbert Georg Borgmann, Felix Bruno Kleine Frauenknecht, Katrin B. M. Mittelbronn, Michel Nazarov, Petr V. |
| contents | We provide in this paper a comprehensive comparison of various transfer learning strategies and deep learning architectures for computer-aided classification of adult-type diffuse gliomas. We evaluate the generalizability of out-of-domain ImageNet representations for a target domain of histopathological images, and study the impact of in-domain adaptation using self-supervised and multi-task learning approaches for pretraining the models using the medium-to-large scale datasets of histopathological images. A semi-supervised learning approach is furthermore proposed, where the fine-tuned models are utilized to predict the labels of unannotated regions of the whole slide images (WSI). The models are subsequently retrained using the ground-truth labels and weak labels determined in the previous step, providing superior performance in comparison to standard in-domain transfer learning with balanced accuracy of 96.91% and F1-score 97.07%, and minimizing the pathologist's efforts for annotation. Finally, we provide a visualization tool working at WSI level which generates heatmaps that highlight tumor areas; thus, providing insights to pathologists concerning the most informative parts of the WSI. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_17223 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Glioma subtype classification from histopathological images using in-domain and out-of-domain transfer learning: An experimental study Despotovic, Vladimir Kim, Sang-Yoon Hau, Ann-Christin Kakoichankava, Aliaksandra Klamminger, Gilbert Georg Borgmann, Felix Bruno Kleine Frauenknecht, Katrin B. M. Mittelbronn, Michel Nazarov, Petr V. Image and Video Processing Computer Vision and Pattern Recognition We provide in this paper a comprehensive comparison of various transfer learning strategies and deep learning architectures for computer-aided classification of adult-type diffuse gliomas. We evaluate the generalizability of out-of-domain ImageNet representations for a target domain of histopathological images, and study the impact of in-domain adaptation using self-supervised and multi-task learning approaches for pretraining the models using the medium-to-large scale datasets of histopathological images. A semi-supervised learning approach is furthermore proposed, where the fine-tuned models are utilized to predict the labels of unannotated regions of the whole slide images (WSI). The models are subsequently retrained using the ground-truth labels and weak labels determined in the previous step, providing superior performance in comparison to standard in-domain transfer learning with balanced accuracy of 96.91% and F1-score 97.07%, and minimizing the pathologist's efforts for annotation. Finally, we provide a visualization tool working at WSI level which generates heatmaps that highlight tumor areas; thus, providing insights to pathologists concerning the most informative parts of the WSI. |
| title | Glioma subtype classification from histopathological images using in-domain and out-of-domain transfer learning: An experimental study |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2309.17223 |