Salvato in:
| Autori principali: | , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2309.00237 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909271146364928 |
|---|---|
| author | Kweon, Sunjun Kim, Junu Kim, Jiyoun Im, Sujeong Cho, Eunbyeol Bae, Seongsu Oh, Jungwoo Lee, Gyubok Moon, Jong Hak You, Seng Chan Baek, Seungjin Han, Chang Hoon Jung, Yoon Bin Jo, Yohan Choi, Edward |
| author_facet | Kweon, Sunjun Kim, Junu Kim, Jiyoun Im, Sujeong Cho, Eunbyeol Bae, Seongsu Oh, Jungwoo Lee, Gyubok Moon, Jong Hak You, Seng Chan Baek, Seungjin Han, Chang Hoon Jung, Yoon Bin Jo, Yohan Choi, Edward |
| contents | The development of large language models tailored for handling patients' clinical notes is often hindered by the limited accessibility and usability of these notes due to strict privacy regulations. To address these challenges, we first create synthetic large-scale clinical notes using publicly available case reports extracted from biomedical literature. We then use these synthetic notes to train our specialized clinical large language model, Asclepius. While Asclepius is trained on synthetic data, we assess its potential performance in real-world applications by evaluating it using real clinical notes. We benchmark Asclepius against several other large language models, including GPT-3.5-turbo and other open-source alternatives. To further validate our approach using synthetic notes, we also compare Asclepius with its variants trained on real clinical notes. Our findings convincingly demonstrate that synthetic clinical notes can serve as viable substitutes for real ones when constructing high-performing clinical language models. This conclusion is supported by detailed evaluations conducted by both GPT-4 and medical professionals. All resources including weights, codes, and data used in the development of Asclepius are made publicly accessible for future research. (https://github.com/starmpcc/Asclepius) |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_00237 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes Kweon, Sunjun Kim, Junu Kim, Jiyoun Im, Sujeong Cho, Eunbyeol Bae, Seongsu Oh, Jungwoo Lee, Gyubok Moon, Jong Hak You, Seng Chan Baek, Seungjin Han, Chang Hoon Jung, Yoon Bin Jo, Yohan Choi, Edward Computation and Language Artificial Intelligence The development of large language models tailored for handling patients' clinical notes is often hindered by the limited accessibility and usability of these notes due to strict privacy regulations. To address these challenges, we first create synthetic large-scale clinical notes using publicly available case reports extracted from biomedical literature. We then use these synthetic notes to train our specialized clinical large language model, Asclepius. While Asclepius is trained on synthetic data, we assess its potential performance in real-world applications by evaluating it using real clinical notes. We benchmark Asclepius against several other large language models, including GPT-3.5-turbo and other open-source alternatives. To further validate our approach using synthetic notes, we also compare Asclepius with its variants trained on real clinical notes. Our findings convincingly demonstrate that synthetic clinical notes can serve as viable substitutes for real ones when constructing high-performing clinical language models. This conclusion is supported by detailed evaluations conducted by both GPT-4 and medical professionals. All resources including weights, codes, and data used in the development of Asclepius are made publicly accessible for future research. (https://github.com/starmpcc/Asclepius) |
| title | Publicly Shareable Clinical Large Language Model Built on Synthetic Clinical Notes |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2309.00237 |