A Comprehensive Taxonomy of Negation for NLP and Neural Retrievers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Petcu, Roxana, Bhargav, Samarth, de Rijke, Maarten, Kanoulas, Evangelos
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911208045543424
author Petcu, Roxana
Bhargav, Samarth
de Rijke, Maarten
Kanoulas, Evangelos
author_facet Petcu, Roxana
Bhargav, Samarth
de Rijke, Maarten
Kanoulas, Evangelos
contents Understanding and solving complex reasoning tasks is vital for addressing the information needs of a user. Although dense neural models learn contextualised embeddings, they still underperform on queries containing negation. To understand this phenomenon, we study negation in both traditional neural information retrieval and LLM-based models. We (1) introduce a taxonomy of negation that derives from philosophical, linguistic, and logical definitions; (2) generate two benchmark datasets that can be used to evaluate the performance of neural information retrieval models and to fine-tune models for a more robust performance on negation; and (3) propose a logic-based classification mechanism that can be used to analyze the performance of retrieval models on existing datasets. Our taxonomy produces a balanced data distribution over negation types, providing a better training setup that leads to faster convergence on the NevIR dataset. Moreover, we propose a classification schema that reveals the coverage of negation types in existing datasets, offering insights into the factors that might affect the generalization of fine-tuned models on negation.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22337
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Comprehensive Taxonomy of Negation for NLP and Neural Retrievers
Petcu, Roxana
Bhargav, Samarth
de Rijke, Maarten
Kanoulas, Evangelos
Computation and Language
Information Retrieval
Understanding and solving complex reasoning tasks is vital for addressing the information needs of a user. Although dense neural models learn contextualised embeddings, they still underperform on queries containing negation. To understand this phenomenon, we study negation in both traditional neural information retrieval and LLM-based models. We (1) introduce a taxonomy of negation that derives from philosophical, linguistic, and logical definitions; (2) generate two benchmark datasets that can be used to evaluate the performance of neural information retrieval models and to fine-tune models for a more robust performance on negation; and (3) propose a logic-based classification mechanism that can be used to analyze the performance of retrieval models on existing datasets. Our taxonomy produces a balanced data distribution over negation types, providing a better training setup that leads to faster convergence on the NevIR dataset. Moreover, we propose a classification schema that reveals the coverage of negation types in existing datasets, offering insights into the factors that might affect the generalization of fine-tuned models on negation.
title A Comprehensive Taxonomy of Negation for NLP and Neural Retrievers
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2507.22337