Salvato in:
Dettagli Bibliografici
Autori principali: Afzali, Amirabbas, Velae, Amirreza, Ahmadi, Iman, Aliannejadi, Mohammad
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2511.00875
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914130619793408
author Afzali, Amirabbas
Velae, Amirreza
Ahmadi, Iman
Aliannejadi, Mohammad
author_facet Afzali, Amirabbas
Velae, Amirreza
Ahmadi, Iman
Aliannejadi, Mohammad
contents The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When LLMs are integrated into ranking systems, they can propagate these biases, leading to unfair outcomes in critical applications such as search engines and recommendation systems. Backpack Language Models, unlike traditional transformer-based models that treat text sequences as monolithic structures, generate outputs as weighted combinations of non-contextual, learned word aspects, also known as senses. Leveraging this architecture, we propose a framework for debiasing ranking tasks. Our experimental results show that this framework effectively mitigates gender bias in text retrieval and ranking with minimal degradation in performance.
format Preprint
id arxiv_https___arxiv_org_abs_2511_00875
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Controlling Gender Bias in Retrieval via a Backpack Architecture
Afzali, Amirabbas
Velae, Amirreza
Ahmadi, Iman
Aliannejadi, Mohammad
Information Retrieval
Machine Learning
The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When LLMs are integrated into ranking systems, they can propagate these biases, leading to unfair outcomes in critical applications such as search engines and recommendation systems. Backpack Language Models, unlike traditional transformer-based models that treat text sequences as monolithic structures, generate outputs as weighted combinations of non-contextual, learned word aspects, also known as senses. Leveraging this architecture, we propose a framework for debiasing ranking tasks. Our experimental results show that this framework effectively mitigates gender bias in text retrieval and ranking with minimal degradation in performance.
title Controlling Gender Bias in Retrieval via a Backpack Architecture
topic Information Retrieval
Machine Learning
url https://arxiv.org/abs/2511.00875