Exploring new Approaches for Information Retrieval through Natural Language Processing

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Raj, Manak, Mishra, Nidhi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908349872734208
author Raj, Manak
Mishra, Nidhi
author_facet Raj, Manak
Mishra, Nidhi
contents This review paper explores recent advancements and emerging approaches in Information Retrieval (IR) applied to Natural Language Processing (NLP). We examine traditional IR models such as Boolean, vector space, probabilistic, and inference network models, and highlight modern techniques including deep learning, reinforcement learning, and pretrained transformer models like BERT. We discuss key tools and libraries - Lucene, Anserini, and Pyserini - for efficient text indexing and search. A comparative analysis of sparse, dense, and hybrid retrieval methods is presented, along with applications in web search engines, cross-language IR, argument mining, private information retrieval, and hate speech detection. Finally, we identify open challenges and future research directions to enhance retrieval accuracy, scalability, and ethical considerations.
format Preprint
id arxiv_https___arxiv_org_abs_2505_02199
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exploring new Approaches for Information Retrieval through Natural Language Processing
Raj, Manak
Mishra, Nidhi
Information Retrieval
Computation and Language
68T50
H.3.3; I.2.7
This review paper explores recent advancements and emerging approaches in Information Retrieval (IR) applied to Natural Language Processing (NLP). We examine traditional IR models such as Boolean, vector space, probabilistic, and inference network models, and highlight modern techniques including deep learning, reinforcement learning, and pretrained transformer models like BERT. We discuss key tools and libraries - Lucene, Anserini, and Pyserini - for efficient text indexing and search. A comparative analysis of sparse, dense, and hybrid retrieval methods is presented, along with applications in web search engines, cross-language IR, argument mining, private information retrieval, and hate speech detection. Finally, we identify open challenges and future research directions to enhance retrieval accuracy, scalability, and ethical considerations.
title Exploring new Approaches for Information Retrieval through Natural Language Processing
topic Information Retrieval
Computation and Language
68T50
H.3.3; I.2.7
url https://arxiv.org/abs/2505.02199