A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913511359119360 |
|---|---|
| author | Wang, Jinqiang Ning, Huansheng Peng, Yi Wei, Qikai Tesfai, Daniel Mao, Wenwei Zhu, Tao Huang, Runhe |
| author_facet | Wang, Jinqiang Ning, Huansheng Peng, Yi Wei, Qikai Tesfai, Daniel Mao, Wenwei Zhu, Tao Huang, Runhe |
| contents | Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical consultation and diagnosis. These models can smoothly simulate doctor-patient dialogues and provide professional medical advice. Most medical LLMs are developed through continued training of open-source general LLMs, which require significantly fewer computational resources than training LLMs from scratch. Additionally, this approach offers better patient privacy protection than API-based solutions. Given the above advantages, this survey systematically summarizes how to train medical LLMs based on open-source general LLMs from a more fine-grained perspective. It covers (a) how to acquire training corpus and construct customized medical training sets, (b) how to choose an appropriate training paradigm, (c) how to choose a suitable evaluation benchmark, and (d) existing challenges and promising research directions are discussed. This survey can provide guidance for the development of LLMs focused on various medical applications, such as medical education, diagnostic planning, and clinical assistants. Related resources and supplemental information can be found on the GitHub repository. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_10303 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations Wang, Jinqiang Ning, Huansheng Peng, Yi Wei, Qikai Tesfai, Daniel Mao, Wenwei Zhu, Tao Huang, Runhe Computation and Language Artificial Intelligence Large Language Models (LLMs) have demonstrated surprising performance across various natural language processing tasks. Recently, medical LLMs enhanced with domain-specific knowledge have exhibited excellent capabilities in medical consultation and diagnosis. These models can smoothly simulate doctor-patient dialogues and provide professional medical advice. Most medical LLMs are developed through continued training of open-source general LLMs, which require significantly fewer computational resources than training LLMs from scratch. Additionally, this approach offers better patient privacy protection than API-based solutions. Given the above advantages, this survey systematically summarizes how to train medical LLMs based on open-source general LLMs from a more fine-grained perspective. It covers (a) how to acquire training corpus and construct customized medical training sets, (b) how to choose an appropriate training paradigm, (c) how to choose a suitable evaluation benchmark, and (d) existing challenges and promising research directions are discussed. This survey can provide guidance for the development of LLMs focused on various medical applications, such as medical education, diagnostic planning, and clinical assistants. Related resources and supplemental information can be found on the GitHub repository. |
| title | A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluations |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2406.10303 |