CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Valentini, Francisco, Kozlowski, Diego, Larivière, Vincent
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908664171855872
author Valentini, Francisco
Kozlowski, Diego
Larivière, Vincent
author_facet Valentini, Francisco
Kozlowski, Diego
Larivière, Vincent
contents Cross-lingual information retrieval (CLIR) helps users find documents in languages different from their queries. This is especially important in academic search, where key research is often published in non-English languages. We present CLIRudit, a novel English-French academic retrieval dataset built from Érudit, a Canadian publishing platform. Using multilingual metadata, we pair English author-written keywords as queries with non-English abstracts as target documents, a method that can be applied to other languages and repositories. We benchmark various first-stage sparse and dense retrievers, with and without machine translation. We find that dense embeddings without translation perform nearly as well as systems using machine translation, that translating documents is generally more effective than translating queries, and that sparse retrievers with document translation remain competitive while offering greater efficiency. Along with releasing the first English-French academic retrieval dataset, we provide a reproducible benchmarking method to improve access to non-English scholarly content.
format Preprint
id arxiv_https___arxiv_org_abs_2504_16264
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents
Valentini, Francisco
Kozlowski, Diego
Larivière, Vincent
Information Retrieval
Computation and Language
Cross-lingual information retrieval (CLIR) helps users find documents in languages different from their queries. This is especially important in academic search, where key research is often published in non-English languages. We present CLIRudit, a novel English-French academic retrieval dataset built from Érudit, a Canadian publishing platform. Using multilingual metadata, we pair English author-written keywords as queries with non-English abstracts as target documents, a method that can be applied to other languages and repositories. We benchmark various first-stage sparse and dense retrievers, with and without machine translation. We find that dense embeddings without translation perform nearly as well as systems using machine translation, that translating documents is generally more effective than translating queries, and that sparse retrievers with document translation remain competitive while offering greater efficiency. Along with releasing the first English-French academic retrieval dataset, we provide a reproducible benchmarking method to improve access to non-English scholarly content.
title CLIRudit: Cross-Lingual Information Retrieval of Scientific Documents
topic Information Retrieval
Computation and Language
url https://arxiv.org/abs/2504.16264