Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.07468 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929341245423616 |
|---|---|
| author | Chen, Xiaolan Xiang, Jiayang Lu, Shanfu Liu, Yexin He, Mingguang Shi, Danli |
| author_facet | Chen, Xiaolan Xiang, Jiayang Lu, Shanfu Liu, Yexin He, Mingguang Shi, Danli |
| contents | Large language models (LLMs) have emerged as powerful tools with transformative potential across numerous domains, including healthcare and medicine. In the medical domain, LLMs hold promise for tasks ranging from clinical decision support to patient education. However, evaluating the performance of LLMs in medical contexts presents unique challenges due to the complex and critical nature of medical information. This paper provides a comprehensive overview of the landscape of medical LLM evaluation, synthesizing insights from existing studies and highlighting evaluation data sources, task scenarios, and evaluation methods. Additionally, it identifies key challenges and opportunities in medical LLM evaluation, emphasizing the need for continued research and innovation to ensure the responsible integration of LLMs into clinical practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_07468 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Evaluating large language models in medical applications: a survey Chen, Xiaolan Xiang, Jiayang Lu, Shanfu Liu, Yexin He, Mingguang Shi, Danli Computation and Language Artificial Intelligence Large language models (LLMs) have emerged as powerful tools with transformative potential across numerous domains, including healthcare and medicine. In the medical domain, LLMs hold promise for tasks ranging from clinical decision support to patient education. However, evaluating the performance of LLMs in medical contexts presents unique challenges due to the complex and critical nature of medical information. This paper provides a comprehensive overview of the landscape of medical LLM evaluation, synthesizing insights from existing studies and highlighting evaluation data sources, task scenarios, and evaluation methods. Additionally, it identifies key challenges and opportunities in medical LLM evaluation, emphasizing the need for continued research and innovation to ensure the responsible integration of LLMs into clinical practice. |
| title | Evaluating large language models in medical applications: a survey |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2405.07468 |