Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929232704176128 |
|---|---|
| author | Gallegos, Isabel O. Rossi, Ryan A. Barrow, Joe Tanjim, Md Mehrab Yu, Tong Deilamsalehy, Hanieh Zhang, Ruiyi Kim, Sungchul Dernoncourt, Franck |
| author_facet | Gallegos, Isabel O. Rossi, Ryan A. Barrow, Joe Tanjim, Md Mehrab Yu, Tong Deilamsalehy, Hanieh Zhang, Ruiyi Kim, Sungchul Dernoncourt, Franck |
| contents | Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance of bias mitigation techniques, most require modifications to the training data, model parameters, or decoding strategy, which may be infeasible without access to a trainable model. In this work, we leverage the zero-shot capabilities of LLMs to reduce stereotyping in a technique we introduce as zero-shot self-debiasing. With two approaches, self-debiasing via explanation and self-debiasing via reprompting, we show that self-debiasing can significantly reduce the degree of stereotyping across nine different social groups while relying only on the LLM itself and a simple prompt, with explanations correctly identifying invalid assumptions and reprompting delivering the greatest reductions in bias. We hope this work opens inquiry into other zero-shot techniques for bias mitigation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_01981 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes Gallegos, Isabel O. Rossi, Ryan A. Barrow, Joe Tanjim, Md Mehrab Yu, Tong Deilamsalehy, Hanieh Zhang, Ruiyi Kim, Sungchul Dernoncourt, Franck Computation and Language Artificial Intelligence Computers and Society Machine Learning Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance of bias mitigation techniques, most require modifications to the training data, model parameters, or decoding strategy, which may be infeasible without access to a trainable model. In this work, we leverage the zero-shot capabilities of LLMs to reduce stereotyping in a technique we introduce as zero-shot self-debiasing. With two approaches, self-debiasing via explanation and self-debiasing via reprompting, we show that self-debiasing can significantly reduce the degree of stereotyping across nine different social groups while relying only on the LLM itself and a simple prompt, with explanations correctly identifying invalid assumptions and reprompting delivering the greatest reductions in bias. We hope this work opens inquiry into other zero-shot techniques for bias mitigation. |
| title | Self-Debiasing Large Language Models: Zero-Shot Recognition and Reduction of Stereotypes |
| topic | Computation and Language Artificial Intelligence Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2402.01981 |