A Comprehensive Survey of Foundation Models in Medicine

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Khan, Wasif, Leem, Seowung, See, Kyle B., Wong, Joshua K., Zhang, Shaoting, Fang, Ruogu
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915104868532224
author Khan, Wasif
Leem, Seowung
See, Kyle B.
Wong, Joshua K.
Zhang, Shaoting
Fang, Ruogu
author_facet Khan, Wasif
Leem, Seowung
See, Kyle B.
Wong, Joshua K.
Zhang, Shaoting
Fang, Ruogu
contents Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in medicine and healthcare. FMs have demonstrated remarkable success across multiple healthcare domains. However, existing surveys in this field do not comprehensively cover all areas where FMs have made significant strides. In this survey, we present a comprehensive review of FMs in medicine, focusing on their evolution, learning strategies, flagship models, applications, and associated challenges. We examine how prominent FMs, such as the BERT and GPT families, are transforming various aspects of healthcare, including clinical large language models, medical image analysis, and omics research. Additionally, we provide a detailed taxonomy of FM-enabled healthcare applications, spanning clinical natural language processing, medical computer vision, graph learning, and other biology- and omics- related tasks. Despite the transformative potentials of FMs, they also pose unique challenges. This survey delves into these challenges and highlights open research questions and lessons learned to guide researchers and practitioners. Our goal is to provide valuable insights into the capabilities of FMs in health, facilitating responsible deployment and mitigating associated risks.
format Preprint
id arxiv_https___arxiv_org_abs_2406_10729
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Comprehensive Survey of Foundation Models in Medicine
Khan, Wasif
Leem, Seowung
See, Kyle B.
Wong, Joshua K.
Zhang, Shaoting
Fang, Ruogu
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in medicine and healthcare. FMs have demonstrated remarkable success across multiple healthcare domains. However, existing surveys in this field do not comprehensively cover all areas where FMs have made significant strides. In this survey, we present a comprehensive review of FMs in medicine, focusing on their evolution, learning strategies, flagship models, applications, and associated challenges. We examine how prominent FMs, such as the BERT and GPT families, are transforming various aspects of healthcare, including clinical large language models, medical image analysis, and omics research. Additionally, we provide a detailed taxonomy of FM-enabled healthcare applications, spanning clinical natural language processing, medical computer vision, graph learning, and other biology- and omics- related tasks. Despite the transformative potentials of FMs, they also pose unique challenges. This survey delves into these challenges and highlights open research questions and lessons learned to guide researchers and practitioners. Our goal is to provide valuable insights into the capabilities of FMs in health, facilitating responsible deployment and mitigating associated risks.
title A Comprehensive Survey of Foundation Models in Medicine
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.10729