Controlling Gender Bias in Retrieval via a Backpack Architecture
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914130619793408 |
|---|---|
| author | Afzali, Amirabbas Velae, Amirreza Ahmadi, Iman Aliannejadi, Mohammad |
| author_facet | Afzali, Amirabbas Velae, Amirreza Ahmadi, Iman Aliannejadi, Mohammad |
| contents | The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When LLMs are integrated into ranking systems, they can propagate these biases, leading to unfair outcomes in critical applications such as search engines and recommendation systems. Backpack Language Models, unlike traditional transformer-based models that treat text sequences as monolithic structures, generate outputs as weighted combinations of non-contextual, learned word aspects, also known as senses. Leveraging this architecture, we propose a framework for debiasing ranking tasks. Our experimental results show that this framework effectively mitigates gender bias in text retrieval and ranking with minimal degradation in performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_00875 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Controlling Gender Bias in Retrieval via a Backpack Architecture Afzali, Amirabbas Velae, Amirreza Ahmadi, Iman Aliannejadi, Mohammad Information Retrieval Machine Learning The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When LLMs are integrated into ranking systems, they can propagate these biases, leading to unfair outcomes in critical applications such as search engines and recommendation systems. Backpack Language Models, unlike traditional transformer-based models that treat text sequences as monolithic structures, generate outputs as weighted combinations of non-contextual, learned word aspects, also known as senses. Leveraging this architecture, we propose a framework for debiasing ranking tasks. Our experimental results show that this framework effectively mitigates gender bias in text retrieval and ranking with minimal degradation in performance. |
| title | Controlling Gender Bias in Retrieval via a Backpack Architecture |
| topic | Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2511.00875 |