An evaluation of DeepSeek Models in Biomedical Natural Language Processing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915178685136896 |
|---|---|
| author | Zhan, Zaifu Zhou, Shuang Zhou, Huixue Deng, Jiawen Hou, Yu Yeung, Jeremy Zhang, Rui |
| author_facet | Zhan, Zaifu Zhou, Shuang Zhou, Huixue Deng, Jiawen Hou, Yu Yeung, Jeremy Zhang, Rui |
| contents | The advancement of Large Language Models (LLMs) has significantly impacted biomedical Natural Language Processing (NLP), enhancing tasks such as named entity recognition, relation extraction, event extraction, and text classification. In this context, the DeepSeek series of models have shown promising potential in general NLP tasks, yet their capabilities in the biomedical domain remain underexplored. This study evaluates multiple DeepSeek models (Distilled-DeepSeek-R1 series and Deepseek-LLMs) across four key biomedical NLP tasks using 12 datasets, benchmarking them against state-of-the-art alternatives (Llama3-8B, Qwen2.5-7B, Mistral-7B, Phi-4-14B, Gemma-2-9B). Our results reveal that while DeepSeek models perform competitively in named entity recognition and text classification, challenges persist in event and relation extraction due to precision-recall trade-offs. We provide task-specific model recommendations and highlight future research directions. This evaluation underscores the strengths and limitations of DeepSeek models in biomedical NLP, guiding their future deployment and optimization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_00624 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | An evaluation of DeepSeek Models in Biomedical Natural Language Processing Zhan, Zaifu Zhou, Shuang Zhou, Huixue Deng, Jiawen Hou, Yu Yeung, Jeremy Zhang, Rui Computation and Language Artificial Intelligence The advancement of Large Language Models (LLMs) has significantly impacted biomedical Natural Language Processing (NLP), enhancing tasks such as named entity recognition, relation extraction, event extraction, and text classification. In this context, the DeepSeek series of models have shown promising potential in general NLP tasks, yet their capabilities in the biomedical domain remain underexplored. This study evaluates multiple DeepSeek models (Distilled-DeepSeek-R1 series and Deepseek-LLMs) across four key biomedical NLP tasks using 12 datasets, benchmarking them against state-of-the-art alternatives (Llama3-8B, Qwen2.5-7B, Mistral-7B, Phi-4-14B, Gemma-2-9B). Our results reveal that while DeepSeek models perform competitively in named entity recognition and text classification, challenges persist in event and relation extraction due to precision-recall trade-offs. We provide task-specific model recommendations and highlight future research directions. This evaluation underscores the strengths and limitations of DeepSeek models in biomedical NLP, guiding their future deployment and optimization. |
| title | An evaluation of DeepSeek Models in Biomedical Natural Language Processing |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2503.00624 |