Towards Leveraging Large Language Models for Automated Medical Q&A Evaluation
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917767404322816 |
|---|---|
| author | Krolik, Jack Mahal, Herprit Ahmad, Feroz Trivedi, Gaurav Saket, Bahador |
| author_facet | Krolik, Jack Mahal, Herprit Ahmad, Feroz Trivedi, Gaurav Saket, Bahador |
| contents | This paper explores the potential of using Large Language Models (LLMs) to automate the evaluation of responses in medical Question and Answer (Q\&A) systems, a crucial form of Natural Language Processing. Traditionally, human evaluation has been indispensable for assessing the quality of these responses. However, manual evaluation by medical professionals is time-consuming and costly. Our study examines whether LLMs can reliably replicate human evaluations by using questions derived from patient data, thereby saving valuable time for medical experts. While the findings suggest promising results, further research is needed to address more specific or complex questions that were beyond the scope of this initial investigation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_01941 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Leveraging Large Language Models for Automated Medical Q&A Evaluation Krolik, Jack Mahal, Herprit Ahmad, Feroz Trivedi, Gaurav Saket, Bahador Computation and Language Machine Learning I.2.7; J.3 This paper explores the potential of using Large Language Models (LLMs) to automate the evaluation of responses in medical Question and Answer (Q\&A) systems, a crucial form of Natural Language Processing. Traditionally, human evaluation has been indispensable for assessing the quality of these responses. However, manual evaluation by medical professionals is time-consuming and costly. Our study examines whether LLMs can reliably replicate human evaluations by using questions derived from patient data, thereby saving valuable time for medical experts. While the findings suggest promising results, further research is needed to address more specific or complex questions that were beyond the scope of this initial investigation. |
| title | Towards Leveraging Large Language Models for Automated Medical Q&A Evaluation |
| topic | Computation and Language Machine Learning I.2.7; J.3 |
| url | https://arxiv.org/abs/2409.01941 |