An OpenMind for 3D medical vision self-supervised learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915249487085568 |
|---|---|
| author | Wald, Tassilo Ulrich, Constantin Suprijadi, Jonathan Ziegler, Sebastian Nohel, Michal Peretzke, Robin Köhler, Gregor Maier-Hein, Klaus H. |
| author_facet | Wald, Tassilo Ulrich, Constantin Suprijadi, Jonathan Ziegler, Sebastian Nohel, Michal Peretzke, Robin Köhler, Gregor Maier-Hein, Klaus H. |
| contents | The field of self-supervised learning (SSL) for 3D medical images lacks consistency and standardization. While many methods have been developed, it is impossible to identify the current state-of-the-art, due to i) varying and small pretraining datasets, ii) varying architectures, and iii) being evaluated on differing downstream datasets. In this paper, we bring clarity to this field and lay the foundation for further method advancements through three key contributions: We a) publish the largest publicly available pre-training dataset comprising 114k 3D brain MRI volumes, enabling all practitioners to pre-train on a large-scale dataset. We b) benchmark existing 3D self-supervised learning methods on this dataset for a state-of-the-art CNN and Transformer architecture, clarifying the state of 3D SSL pre-training. Among many findings, we show that pre-trained methods can exceed a strong from-scratch nnU-Net ResEnc-L baseline. Lastly, we c) publish the code of our pre-training and fine-tuning frameworks and provide the pre-trained models created during the benchmarking process to facilitate rapid adoption and reproduction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17041 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An OpenMind for 3D medical vision self-supervised learning Wald, Tassilo Ulrich, Constantin Suprijadi, Jonathan Ziegler, Sebastian Nohel, Michal Peretzke, Robin Köhler, Gregor Maier-Hein, Klaus H. Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing The field of self-supervised learning (SSL) for 3D medical images lacks consistency and standardization. While many methods have been developed, it is impossible to identify the current state-of-the-art, due to i) varying and small pretraining datasets, ii) varying architectures, and iii) being evaluated on differing downstream datasets. In this paper, we bring clarity to this field and lay the foundation for further method advancements through three key contributions: We a) publish the largest publicly available pre-training dataset comprising 114k 3D brain MRI volumes, enabling all practitioners to pre-train on a large-scale dataset. We b) benchmark existing 3D self-supervised learning methods on this dataset for a state-of-the-art CNN and Transformer architecture, clarifying the state of 3D SSL pre-training. Among many findings, we show that pre-trained methods can exceed a strong from-scratch nnU-Net ResEnc-L baseline. Lastly, we c) publish the code of our pre-training and fine-tuning frameworks and provide the pre-trained models created during the benchmarking process to facilitate rapid adoption and reproduction. |
| title | An OpenMind for 3D medical vision self-supervised learning |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Image and Video Processing |
| url | https://arxiv.org/abs/2412.17041 |