MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jin, Qiao, Kim, Won, Chen, Qingyu, Comeau, Donald C., Yeganova, Lana, Wilbur, W. John, Lu, Zhiyong
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916090745978880
author Jin, Qiao
Kim, Won
Chen, Qingyu
Comeau, Donald C.
Yeganova, Lana
Wilbur, W. John
Lu, Zhiyong
author_facet Jin, Qiao
Kim, Won
Chen, Qingyu
Comeau, Donald C.
Yeganova, Lana
Wilbur, W. John
Lu, Zhiyong
contents Information retrieval (IR) is essential in biomedical knowledge acquisition and clinical decision support. While recent progress has shown that language model encoders perform better semantic retrieval, training such models requires abundant query-article annotations that are difficult to obtain in biomedicine. As a result, most biomedical IR systems only conduct lexical matching. In response, we introduce MedCPT, a first-of-its-kind Contrastively Pre-trained Transformer model for zero-shot semantic IR in biomedicine. To train MedCPT, we collected an unprecedented scale of 255 million user click logs from PubMed. With such data, we use contrastive learning to train a pair of closely-integrated retriever and re-ranker. Experimental results show that MedCPT sets new state-of-the-art performance on six biomedical IR tasks, outperforming various baselines including much larger models such as GPT-3-sized cpt-text-XL. In addition, MedCPT also generates better biomedical article and sentence representations for semantic evaluations. As such, MedCPT can be readily applied to various real-world biomedical IR tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2307_00589
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval
Jin, Qiao
Kim, Won
Chen, Qingyu
Comeau, Donald C.
Yeganova, Lana
Wilbur, W. John
Lu, Zhiyong
Information Retrieval
Artificial Intelligence
Computation and Language
Quantitative Methods
Information retrieval (IR) is essential in biomedical knowledge acquisition and clinical decision support. While recent progress has shown that language model encoders perform better semantic retrieval, training such models requires abundant query-article annotations that are difficult to obtain in biomedicine. As a result, most biomedical IR systems only conduct lexical matching. In response, we introduce MedCPT, a first-of-its-kind Contrastively Pre-trained Transformer model for zero-shot semantic IR in biomedicine. To train MedCPT, we collected an unprecedented scale of 255 million user click logs from PubMed. With such data, we use contrastive learning to train a pair of closely-integrated retriever and re-ranker. Experimental results show that MedCPT sets new state-of-the-art performance on six biomedical IR tasks, outperforming various baselines including much larger models such as GPT-3-sized cpt-text-XL. In addition, MedCPT also generates better biomedical article and sentence representations for semantic evaluations. As such, MedCPT can be readily applied to various real-world biomedical IR tasks.
title MedCPT: Contrastive Pre-trained Transformers with Large-scale PubMed Search Logs for Zero-shot Biomedical Information Retrieval
topic Information Retrieval
Artificial Intelligence
Computation and Language
Quantitative Methods
url https://arxiv.org/abs/2307.00589