Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916850007277568 |
|---|---|
| author | Jahan, Israt Laskar, Md Tahmid Rahman Peng, Chun Huang, Jimmy |
| author_facet | Jahan, Israt Laskar, Md Tahmid Rahman Peng, Chun Huang, Jimmy |
| contents | This paper presents a comprehensive evaluation of cost-efficient Large Language Models (LLMs) for diverse biomedical tasks spanning both text and image modalities. We evaluated a range of closed-source and open-source LLMs on tasks such as biomedical text classification and generation, question answering, and multimodal image processing. Our experimental findings indicate that there is no single LLM that can consistently outperform others across all tasks. Instead, different LLMs excel in different tasks. While some closed-source LLMs demonstrate strong performance on specific tasks, their open-source counterparts achieve comparable results (sometimes even better), with additional benefits like faster inference and enhanced privacy. Our experimental results offer valuable insights for selecting models that are optimally suited for specific biomedical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_14045 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks Jahan, Israt Laskar, Md Tahmid Rahman Peng, Chun Huang, Jimmy Computation and Language This paper presents a comprehensive evaluation of cost-efficient Large Language Models (LLMs) for diverse biomedical tasks spanning both text and image modalities. We evaluated a range of closed-source and open-source LLMs on tasks such as biomedical text classification and generation, question answering, and multimodal image processing. Our experimental findings indicate that there is no single LLM that can consistently outperform others across all tasks. Instead, different LLMs excel in different tasks. While some closed-source LLMs demonstrate strong performance on specific tasks, their open-source counterparts achieve comparable results (sometimes even better), with additional benefits like faster inference and enhanced privacy. Our experimental results offer valuable insights for selecting models that are optimally suited for specific biomedical applications. |
| title | Evaluating the Effectiveness of Cost-Efficient Large Language Models in Benchmark Biomedical Tasks |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2507.14045 |