Towards Scalable Foundation Models for Digital Dermatology
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910689918976000 |
|---|---|
| author | Gröger, Fabian Gottfrois, Philippe Amruthalingam, Ludovic Gonzalez-Jimenez, Alvaro Lionetti, Simone Soenksen-Martinez, Luis R. Navarini, Alexander A. Pouly, Marc |
| author_facet | Gröger, Fabian Gottfrois, Philippe Amruthalingam, Ludovic Gonzalez-Jimenez, Alvaro Lionetti, Simone Soenksen-Martinez, Luis R. Navarini, Alexander A. Pouly, Marc |
| contents | The growing demand for accurate and equitable AI models in digital dermatology faces a significant challenge: the lack of diverse, high-quality labeled data. In this work, we investigate the potential of domain-specific foundation models for dermatology in addressing this challenge. We utilize self-supervised learning (SSL) techniques to pre-train models on a dataset of over 240,000 dermatological images from public and private collections. Our study considers several SSL methods and compares the resulting foundation models against domain-agnostic models like those pre-trained on ImageNet and state-of-the-art models such as MONET across 12 downstream tasks. Unlike previous research, we emphasize the development of smaller models that are more suitable for resource-limited clinical settings, facilitating easier adaptation to a broad range of use cases. Results show that models pre-trained in this work not only outperform general-purpose models but also approach the performance of models 50 times larger on clinically relevant diagnostic tasks. To promote further research in this direction, we publicly release both the training code and the foundation models, which can benefit clinicians in dermatological applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_05514 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Scalable Foundation Models for Digital Dermatology Gröger, Fabian Gottfrois, Philippe Amruthalingam, Ludovic Gonzalez-Jimenez, Alvaro Lionetti, Simone Soenksen-Martinez, Luis R. Navarini, Alexander A. Pouly, Marc Computer Vision and Pattern Recognition Artificial Intelligence The growing demand for accurate and equitable AI models in digital dermatology faces a significant challenge: the lack of diverse, high-quality labeled data. In this work, we investigate the potential of domain-specific foundation models for dermatology in addressing this challenge. We utilize self-supervised learning (SSL) techniques to pre-train models on a dataset of over 240,000 dermatological images from public and private collections. Our study considers several SSL methods and compares the resulting foundation models against domain-agnostic models like those pre-trained on ImageNet and state-of-the-art models such as MONET across 12 downstream tasks. Unlike previous research, we emphasize the development of smaller models that are more suitable for resource-limited clinical settings, facilitating easier adaptation to a broad range of use cases. Results show that models pre-trained in this work not only outperform general-purpose models but also approach the performance of models 50 times larger on clinically relevant diagnostic tasks. To promote further research in this direction, we publicly release both the training code and the foundation models, which can benefit clinicians in dermatological applications. |
| title | Towards Scalable Foundation Models for Digital Dermatology |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2411.05514 |