Saved in:
Bibliographic Details
Main Authors: Stachura, Damian, Konieczna, Joanna, Nowak, Artur
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.18843
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908555302404096
author Stachura, Damian
Konieczna, Joanna
Nowak, Artur
author_facet Stachura, Damian
Konieczna, Joanna
Nowak, Artur
contents Open-weight versions of large language models (LLMs) are rapidly advancing, with state-of-the-art models like DeepSeek-V3 now performing comparably to proprietary LLMs. This progression raises the question of whether small open-weight LLMs are capable of effectively replacing larger closed-source models. We are particularly interested in the context of biomedical question-answering, a domain we explored by participating in Task 13B Phase B of the BioASQ challenge. In this work, we compare several open-weight models against top-performing systems such as GPT-4o, GPT-4.1, Claude 3.5 Sonnet, and Claude 3.7 Sonnet. To enhance question answering capabilities, we use various techniques including retrieving the most relevant snippets based on embedding distance, in-context learning, and structured outputs. For certain submissions, we utilize ensemble approaches to leverage the diverse outputs generated by different models for exact-answer questions. Our results demonstrate that open-weight LLMs are comparable to proprietary ones. In some instances, open-weight LLMs even surpassed their closed counterparts, particularly when ensembling strategies were applied. All code is publicly available at https://github.com/evidenceprime/BioASQ-13b.
format Preprint
id arxiv_https___arxiv_org_abs_2509_18843
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Are Smaller Open-Weight LLMs Closing the Gap to Proprietary Models for Biomedical Question Answering?
Stachura, Damian
Konieczna, Joanna
Nowak, Artur
Computation and Language
Information Retrieval
Machine Learning
Open-weight versions of large language models (LLMs) are rapidly advancing, with state-of-the-art models like DeepSeek-V3 now performing comparably to proprietary LLMs. This progression raises the question of whether small open-weight LLMs are capable of effectively replacing larger closed-source models. We are particularly interested in the context of biomedical question-answering, a domain we explored by participating in Task 13B Phase B of the BioASQ challenge. In this work, we compare several open-weight models against top-performing systems such as GPT-4o, GPT-4.1, Claude 3.5 Sonnet, and Claude 3.7 Sonnet. To enhance question answering capabilities, we use various techniques including retrieving the most relevant snippets based on embedding distance, in-context learning, and structured outputs. For certain submissions, we utilize ensemble approaches to leverage the diverse outputs generated by different models for exact-answer questions. Our results demonstrate that open-weight LLMs are comparable to proprietary ones. In some instances, open-weight LLMs even surpassed their closed counterparts, particularly when ensembling strategies were applied. All code is publicly available at https://github.com/evidenceprime/BioASQ-13b.
title Are Smaller Open-Weight LLMs Closing the Gap to Proprietary Models for Biomedical Question Answering?
topic Computation and Language
Information Retrieval
Machine Learning
url https://arxiv.org/abs/2509.18843