From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912729149734912 |
|---|---|
| author | Niu, Qian Chen, Keyu Li, Ming Feng, Pohsun Bi, Ziqian Yan, Lawrence KQ Zhang, Yichao Yin, Caitlyn Heqi Fei, Cheng Liu, Junyu Wang, Tianyang Wang, Yunze Chen, Silin Liu, Ming Peng, Benji Song, Xinyuan Qin, Ziyuan Bao, Riyang Jiang, Zekun |
| author_facet | Niu, Qian Chen, Keyu Li, Ming Feng, Pohsun Bi, Ziqian Yan, Lawrence KQ Zhang, Yichao Yin, Caitlyn Heqi Fei, Cheng Liu, Junyu Wang, Tianyang Wang, Yunze Chen, Silin Liu, Ming Peng, Benji Song, Xinyuan Qin, Ziyuan Bao, Riyang Jiang, Zekun |
| contents | Large Language Models (LLMs) have rapidly evolved from text-based systems to multimodal platforms, significantly impacting various sectors including healthcare. This comprehensive review explores the progression of LLMs to Multimodal Large Language Models (MLLMs) and their growing influence in medical practice. We examine the current landscape of MLLMs in healthcare, analyzing their applications across clinical decision support, medical imaging, patient engagement, and research. The review highlights the unique capabilities of MLLMs in integrating diverse data types, such as text, images, and audio, to provide more comprehensive insights into patient health. We also address the challenges facing MLLM implementation, including data limitations, technical hurdles, and ethical considerations. By identifying key research gaps, this paper aims to guide future investigations in areas such as dataset development, modality alignment methods, and the establishment of ethical guidelines. As MLLMs continue to shape the future of healthcare, understanding their potential and limitations is crucial for their responsible and effective integration into medical practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_01812 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice Niu, Qian Chen, Keyu Li, Ming Feng, Pohsun Bi, Ziqian Yan, Lawrence KQ Zhang, Yichao Yin, Caitlyn Heqi Fei, Cheng Liu, Junyu Wang, Tianyang Wang, Yunze Chen, Silin Liu, Ming Peng, Benji Song, Xinyuan Qin, Ziyuan Bao, Riyang Jiang, Zekun Computers and Society Artificial Intelligence Computation and Language Large Language Models (LLMs) have rapidly evolved from text-based systems to multimodal platforms, significantly impacting various sectors including healthcare. This comprehensive review explores the progression of LLMs to Multimodal Large Language Models (MLLMs) and their growing influence in medical practice. We examine the current landscape of MLLMs in healthcare, analyzing their applications across clinical decision support, medical imaging, patient engagement, and research. The review highlights the unique capabilities of MLLMs in integrating diverse data types, such as text, images, and audio, to provide more comprehensive insights into patient health. We also address the challenges facing MLLM implementation, including data limitations, technical hurdles, and ethical considerations. By identifying key research gaps, this paper aims to guide future investigations in areas such as dataset development, modality alignment methods, and the establishment of ethical guidelines. As MLLMs continue to shape the future of healthcare, understanding their potential and limitations is crucial for their responsible and effective integration into medical practice. |
| title | From Text to Multimodality: Exploring the Evolution and Impact of Large Language Models in Medical Practice |
| topic | Computers and Society Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2410.01812 |