Collaboration among Multiple Large Language Models for Medical Question Answering
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915298133671936 |
|---|---|
| author | Shang, Kexin Chang, Chia-Hsuan Yang, Christopher C. |
| author_facet | Shang, Kexin Chang, Chia-Hsuan Yang, Christopher C. |
| contents | Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect from multiple LLMs' expertise and background. In this study, we propose a multi-LLM collaboration framework tailored on a medical multiple-choice questions dataset. Through post-hoc analysis on 3 pre-trained LLM participants, our framework is proved to boost all LLMs reasoning ability as well as alleviate their divergence among questions. We also measure an LLM's confidence when it confronts with adversary opinions from other LLMs and observe a concurrence between LLM's confidence and prediction accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16648 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Collaboration among Multiple Large Language Models for Medical Question Answering Shang, Kexin Chang, Chia-Hsuan Yang, Christopher C. Computation and Language Artificial Intelligence Empowered by vast internal knowledge reservoir, the new generation of large language models (LLMs) demonstrate untapped potential to tackle medical tasks. However, there is insufficient effort made towards summoning up a synergic effect from multiple LLMs' expertise and background. In this study, we propose a multi-LLM collaboration framework tailored on a medical multiple-choice questions dataset. Through post-hoc analysis on 3 pre-trained LLM participants, our framework is proved to boost all LLMs reasoning ability as well as alleviate their divergence among questions. We also measure an LLM's confidence when it confronts with adversary opinions from other LLMs and observe a concurrence between LLM's confidence and prediction accuracy. |
| title | Collaboration among Multiple Large Language Models for Medical Question Answering |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2505.16648 |