Saved in:
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.08614 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917188246437888 |
|---|---|
| author | Aityan, Sergey K. Mosaddegh, Abdolreza Herrero, Rolando Tayyar, Haitham Han, Jiang Sawant, Vikram Chen, Qi Jain, Rishabh Senthamaraikannan, Aruna Wood, Stephen Mersini, Manuel Lazzaro, Rita Balzanelli, Mario Iacovazzo, Nicola Isacco, Ciro Gargiulo |
| author_facet | Aityan, Sergey K. Mosaddegh, Abdolreza Herrero, Rolando Tayyar, Haitham Han, Jiang Sawant, Vikram Chen, Qi Jain, Rishabh Senthamaraikannan, Aruna Wood, Stephen Mersini, Manuel Lazzaro, Rita Balzanelli, Mario Iacovazzo, Nicola Isacco, Ciro Gargiulo |
| contents | Medical decision-support and advising systems are critical for emergency physicians to quickly and accurately assess patients' conditions and make diagnosis. Artificial Intelligence (AI) has emerged as a transformative force in healthcare in recent years and Large Language Models (LLMs) have been employed in various fields of medical decision-support systems. We studied responses of a group of different LLMs to real cases in emergency medicine. The results of our study on five most renown LLMs showed significant differences in capabilities of Large Language Models for diagnostics acute diseases in medical emergencies with accuracy ranging between 58% and 65%. This accuracy significantly exceeds the reported accuracy of human doctors. We built a super-learner MEDAS (Medical Emergency Diagnostic Advising System) of five major LLMs - Gemini, Llama, Grok, GPT, and Claude). The super-learner produces higher diagnostic accuracy, 70%, even with a quite basic meta-learner. However, at least one of the integrated LLMs in the same super-learner produces 85% correct diagnoses. The super-learner integrates a cluster of LLMs using a meta-learner capable of learning different capabilities of each LLM to leverage diagnostic accuracy of the model by collective capabilities of all LLMs in the cluster. The results of our study showed that aggregated diagnostic accuracy provided by a meta-learning approach exceeds that of any individual LLM, suggesting that the super-learner can take advantage of the combined knowledge of the medical datasets used to train the group of LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_08614 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Super-Learner with Large Language Models for Medical Emergency Advising Aityan, Sergey K. Mosaddegh, Abdolreza Herrero, Rolando Tayyar, Haitham Han, Jiang Sawant, Vikram Chen, Qi Jain, Rishabh Senthamaraikannan, Aruna Wood, Stephen Mersini, Manuel Lazzaro, Rita Balzanelli, Mario Iacovazzo, Nicola Isacco, Ciro Gargiulo Computation and Language I.2.1; I.2.11; I.2.m Medical decision-support and advising systems are critical for emergency physicians to quickly and accurately assess patients' conditions and make diagnosis. Artificial Intelligence (AI) has emerged as a transformative force in healthcare in recent years and Large Language Models (LLMs) have been employed in various fields of medical decision-support systems. We studied responses of a group of different LLMs to real cases in emergency medicine. The results of our study on five most renown LLMs showed significant differences in capabilities of Large Language Models for diagnostics acute diseases in medical emergencies with accuracy ranging between 58% and 65%. This accuracy significantly exceeds the reported accuracy of human doctors. We built a super-learner MEDAS (Medical Emergency Diagnostic Advising System) of five major LLMs - Gemini, Llama, Grok, GPT, and Claude). The super-learner produces higher diagnostic accuracy, 70%, even with a quite basic meta-learner. However, at least one of the integrated LLMs in the same super-learner produces 85% correct diagnoses. The super-learner integrates a cluster of LLMs using a meta-learner capable of learning different capabilities of each LLM to leverage diagnostic accuracy of the model by collective capabilities of all LLMs in the cluster. The results of our study showed that aggregated diagnostic accuracy provided by a meta-learning approach exceeds that of any individual LLM, suggesting that the super-learner can take advantage of the combined knowledge of the medical datasets used to train the group of LLMs. |
| title | A Super-Learner with Large Language Models for Medical Emergency Advising |
| topic | Computation and Language I.2.1; I.2.11; I.2.m |
| url | https://arxiv.org/abs/2511.08614 |