Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.02621 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913595822964736 |
|---|---|
| author | Sun, Kai Xue, Siyan Sun, Fuchun Sun, Haoran Luo, Yu Wang, Ling Wang, Siyuan Guo, Na Liu, Lei Zhao, Tian Wang, Xinzhou Yang, Lei Jin, Shuo Yan, Jun Dong, Jiahong |
| author_facet | Sun, Kai Xue, Siyan Sun, Fuchun Sun, Haoran Luo, Yu Wang, Ling Wang, Siyuan Guo, Na Liu, Lei Zhao, Tian Wang, Xinzhou Yang, Lei Jin, Shuo Yan, Jun Dong, Jiahong |
| contents | Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus driving the pursuit of precision medicine. The growing availability of multi-organ and multimodal datasets has accelerated the development of large-scale Medical Multimodal Foundation Models (MMFMs). These models, known for their strong generalization capabilities and rich representational power, are increasingly being adapted to address a wide range of clinical tasks, from early diagnosis to personalized treatment strategies. This review offers a comprehensive analysis of recent developments in MMFMs, focusing on three key aspects: datasets, model architectures, and clinical applications. We also explore the challenges and opportunities in optimizing multimodal representations and discuss how these advancements are shaping the future of healthcare by enabling improved patient outcomes and more efficient clinical workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_02621 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions Sun, Kai Xue, Siyan Sun, Fuchun Sun, Haoran Luo, Yu Wang, Ling Wang, Siyuan Guo, Na Liu, Lei Zhao, Tian Wang, Xinzhou Yang, Lei Jin, Shuo Yan, Jun Dong, Jiahong Artificial Intelligence Machine Learning Recent advancements in deep learning have significantly revolutionized the field of clinical diagnosis and treatment, offering novel approaches to improve diagnostic precision and treatment efficacy across diverse clinical domains, thus driving the pursuit of precision medicine. The growing availability of multi-organ and multimodal datasets has accelerated the development of large-scale Medical Multimodal Foundation Models (MMFMs). These models, known for their strong generalization capabilities and rich representational power, are increasingly being adapted to address a wide range of clinical tasks, from early diagnosis to personalized treatment strategies. This review offers a comprehensive analysis of recent developments in MMFMs, focusing on three key aspects: datasets, model architectures, and clinical applications. We also explore the challenges and opportunities in optimizing multimodal representations and discuss how these advancements are shaping the future of healthcare by enabling improved patient outcomes and more efficient clinical workflows. |
| title | Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2412.02621 |