Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.19722 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916759289724928 |
|---|---|
| author | Ai, Yihao Ning, Zhiyuan Dai, Weiwei Wang, Pengfei Du, Yi Cui, Wenjuan Liu, Kunpeng Zhou, Yuanchun |
| author_facet | Ai, Yihao Ning, Zhiyuan Dai, Weiwei Wang, Pengfei Du, Yi Cui, Wenjuan Liu, Kunpeng Zhou, Yuanchun |
| contents | Biomedical entity linking aims to map nonstandard entities to standard entities in a knowledge base. Traditional supervised methods perform well but require extensive annotated data to transfer, limiting their usage in low-resource scenarios. Large language models (LLMs), especially closed-source LLMs, can address these but risk stability issues and high economic costs: using these models is restricted by commercial companies and brings significant economic costs when dealing with large amounts of data. To address this, we propose ``RPDR'', a framework combining closed-source LLMs and open-source LLMs for re-ranking candidates retrieved by a retriever fine-tuned with a small amount of data. By prompting a closed-source LLM to generate training data from unannotated data and fine-tuning an open-source LLM for re-ranking, we effectively distill the knowledge to the open-source LLM that can be deployed locally, thus avoiding the stability issues and the problem of high economic costs. We evaluate RPDR on two datasets, including one real-world dataset and one publicly available dataset involving two languages: Chinese and English. RPDR achieves 0.019 Acc@1 improvement and 0.036 Acc@1 improvement on the Aier dataset and the Ask A Patient dataset when the amount of training data is not enough. The results demonstrate the superiority and generalizability of the proposed framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_19722 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Distilling Closed-Source LLM's Knowledge for Locally Stable and Economic Biomedical Entity Linking Ai, Yihao Ning, Zhiyuan Dai, Weiwei Wang, Pengfei Du, Yi Cui, Wenjuan Liu, Kunpeng Zhou, Yuanchun Computation and Language Artificial Intelligence Biomedical entity linking aims to map nonstandard entities to standard entities in a knowledge base. Traditional supervised methods perform well but require extensive annotated data to transfer, limiting their usage in low-resource scenarios. Large language models (LLMs), especially closed-source LLMs, can address these but risk stability issues and high economic costs: using these models is restricted by commercial companies and brings significant economic costs when dealing with large amounts of data. To address this, we propose ``RPDR'', a framework combining closed-source LLMs and open-source LLMs for re-ranking candidates retrieved by a retriever fine-tuned with a small amount of data. By prompting a closed-source LLM to generate training data from unannotated data and fine-tuning an open-source LLM for re-ranking, we effectively distill the knowledge to the open-source LLM that can be deployed locally, thus avoiding the stability issues and the problem of high economic costs. We evaluate RPDR on two datasets, including one real-world dataset and one publicly available dataset involving two languages: Chinese and English. RPDR achieves 0.019 Acc@1 improvement and 0.036 Acc@1 improvement on the Aier dataset and the Ask A Patient dataset when the amount of training data is not enough. The results demonstrate the superiority and generalizability of the proposed framework. |
| title | Distilling Closed-Source LLM's Knowledge for Locally Stable and Economic Biomedical Entity Linking |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2505.19722 |