Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916362830479360 |
|---|---|
| author | Deng, Yongxin Qiu, Xihe Tan, Xiaoyu Pan, Jing Jue, Chen Fang, Zhijun Xu, Yinghui Chu, Wei Qi, Yuan |
| author_facet | Deng, Yongxin Qiu, Xihe Tan, Xiaoyu Pan, Jing Jue, Chen Fang, Zhijun Xu, Yinghui Chu, Wei Qi, Yuan |
| contents | Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based attack methods can still extract these biases from the model's weights. Moreover, these biases frequently appear subtly when LLMs are prompted to perform identical tasks across different demographic groups, thereby camouflaging their presence. To address this issue, we have formally defined the implicit bias problem and developed an innovative framework for bias removal based on Bayesian theory, Bayesian-Theory based Bias Removal (BTBR). BTBR employs likelihood ratio screening to pinpoint data entries within publicly accessible biased datasets that represent biases inadvertently incorporated during the LLM training phase. It then automatically constructs relevant knowledge triples and expunges bias information from LLMs using model editing techniques. Through extensive experimentation, we have confirmed the presence of the implicit bias problem in LLMs and demonstrated the effectiveness of our BTBR approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_10608 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory Deng, Yongxin Qiu, Xihe Tan, Xiaoyu Pan, Jing Jue, Chen Fang, Zhijun Xu, Yinghui Chu, Wei Qi, Yuan Computation and Language Artificial Intelligence Large language models (LLMs) are trained on extensive text corpora, which inevitably include biased information. Although techniques such as Affective Alignment can mitigate some negative impacts of these biases, existing prompt-based attack methods can still extract these biases from the model's weights. Moreover, these biases frequently appear subtly when LLMs are prompted to perform identical tasks across different demographic groups, thereby camouflaging their presence. To address this issue, we have formally defined the implicit bias problem and developed an innovative framework for bias removal based on Bayesian theory, Bayesian-Theory based Bias Removal (BTBR). BTBR employs likelihood ratio screening to pinpoint data entries within publicly accessible biased datasets that represent biases inadvertently incorporated during the LLM training phase. It then automatically constructs relevant knowledge triples and expunges bias information from LLMs using model editing techniques. Through extensive experimentation, we have confirmed the presence of the implicit bias problem in LLMs and demonstrated the effectiveness of our BTBR approach. |
| title | Promoting Equality in Large Language Models: Identifying and Mitigating the Implicit Bias based on Bayesian Theory |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2408.10608 |