Taxonomy-guided Semantic Indexing for Academic Paper Search

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Kang, SeongKu, Zhang, Yunyi, Jiang, Pengcheng, Lee, Dongha, Han, Jiawei, Yu, Hwanjo
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914988489179136
author Kang, SeongKu
Zhang, Yunyi
Jiang, Pengcheng
Lee, Dongha
Han, Jiawei
Yu, Hwanjo
author_facet Kang, SeongKu
Zhang, Yunyi
Jiang, Pengcheng
Lee, Dongha
Han, Jiawei
Yu, Hwanjo
contents Academic paper search is an essential task for efficient literature discovery and scientific advancement. While dense retrieval has advanced various ad-hoc searches, it often struggles to match the underlying academic concepts between queries and documents, which is critical for paper search. To enable effective academic concept matching for paper search, we propose Taxonomy-guided Semantic Indexing (TaxoIndex) framework. TaxoIndex extracts key concepts from papers and organizes them as a semantic index guided by an academic taxonomy, and then leverages this index as foundational knowledge to identify academic concepts and link queries and documents. As a plug-and-play framework, TaxoIndex can be flexibly employed to enhance existing dense retrievers. Extensive experiments show that TaxoIndex brings significant improvements, even with highly limited training data, and greatly enhances interpretability.
format Preprint
id arxiv_https___arxiv_org_abs_2410_19218
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Taxonomy-guided Semantic Indexing for Academic Paper Search
Kang, SeongKu
Zhang, Yunyi
Jiang, Pengcheng
Lee, Dongha
Han, Jiawei
Yu, Hwanjo
Information Retrieval
Artificial Intelligence
Academic paper search is an essential task for efficient literature discovery and scientific advancement. While dense retrieval has advanced various ad-hoc searches, it often struggles to match the underlying academic concepts between queries and documents, which is critical for paper search. To enable effective academic concept matching for paper search, we propose Taxonomy-guided Semantic Indexing (TaxoIndex) framework. TaxoIndex extracts key concepts from papers and organizes them as a semantic index guided by an academic taxonomy, and then leverages this index as foundational knowledge to identify academic concepts and link queries and documents. As a plug-and-play framework, TaxoIndex can be flexibly employed to enhance existing dense retrievers. Extensive experiments show that TaxoIndex brings significant improvements, even with highly limited training data, and greatly enhances interpretability.
title Taxonomy-guided Semantic Indexing for Academic Paper Search
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2410.19218