Fairness in Large Language Models: A Taxonomic Survey

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chu, Zhibo, Wang, Zichong, Zhang, Wenbin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917872883728384
author Chu, Zhibo
Wang, Zichong
Zhang, Wenbin
author_facet Chu, Zhibo
Wang, Zichong
Zhang, Wenbin
contents Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently, they may lead to discriminatory outcomes against certain communities, particularly marginalized populations, prompting extensive study in fair LLMs. On the other hand, fairness in LLMs, in contrast to fairness in traditional machine learning, entails exclusive backgrounds, taxonomies, and fulfillment techniques. To this end, this survey presents a comprehensive overview of recent advances in the existing literature concerning fair LLMs. Specifically, a brief introduction to LLMs is provided, followed by an analysis of factors contributing to bias in LLMs. Additionally, the concept of fairness in LLMs is discussed categorically, summarizing metrics for evaluating bias in LLMs and existing algorithms for promoting fairness. Furthermore, resources for evaluating bias in LLMs, including toolkits and datasets, are summarized. Finally, existing research challenges and open questions are discussed.
format Preprint
id arxiv_https___arxiv_org_abs_2404_01349
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fairness in Large Language Models: A Taxonomic Survey
Chu, Zhibo
Wang, Zichong
Zhang, Wenbin
Computation and Language
Artificial Intelligence
Large Language Models (LLMs) have demonstrated remarkable success across various domains. However, despite their promising performance in numerous real-world applications, most of these algorithms lack fairness considerations. Consequently, they may lead to discriminatory outcomes against certain communities, particularly marginalized populations, prompting extensive study in fair LLMs. On the other hand, fairness in LLMs, in contrast to fairness in traditional machine learning, entails exclusive backgrounds, taxonomies, and fulfillment techniques. To this end, this survey presents a comprehensive overview of recent advances in the existing literature concerning fair LLMs. Specifically, a brief introduction to LLMs is provided, followed by an analysis of factors contributing to bias in LLMs. Additionally, the concept of fairness in LLMs is discussed categorically, summarizing metrics for evaluating bias in LLMs and existing algorithms for promoting fairness. Furthermore, resources for evaluating bias in LLMs, including toolkits and datasets, are summarized. Finally, existing research challenges and open questions are discussed.
title Fairness in Large Language Models: A Taxonomic Survey
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2404.01349