Soft-prompt Tuning for Large Language Models to Evaluate Bias
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929264891265024 |
|---|---|
| author | Tian, Jacob-Junqi Emerson, David Miyandoab, Sevil Zanjani Pandya, Deval Seyyed-Kalantari, Laleh Khattak, Faiza Khan |
| author_facet | Tian, Jacob-Junqi Emerson, David Miyandoab, Sevil Zanjani Pandya, Deval Seyyed-Kalantari, Laleh Khattak, Faiza Khan |
| contents | Prompting large language models has gained immense popularity in recent years due to the advantage of producing good results even without the need for labelled data. However, this requires prompt tuning to get optimal prompts that lead to better model performances. In this paper, we explore the use of soft-prompt tuning on sentiment classification task to quantify the biases of large language models (LLMs) such as Open Pre-trained Transformers (OPT) and Galactica language model. Since these models are trained on real-world data that could be prone to bias toward certain groups of populations, it is important to identify these underlying issues. Using soft-prompts to evaluate bias gives us the extra advantage of avoiding the human-bias injection that can be caused by manually designed prompts. We check the model biases on different sensitive attributes using the group fairness (bias) and find interesting bias patterns. Since LLMs have been used in the industry in various applications, it is crucial to identify the biases before deploying these models in practice. We open-source our pipeline and encourage industry researchers to adapt our work to their use cases. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2306_04735 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Soft-prompt Tuning for Large Language Models to Evaluate Bias Tian, Jacob-Junqi Emerson, David Miyandoab, Sevil Zanjani Pandya, Deval Seyyed-Kalantari, Laleh Khattak, Faiza Khan Computation and Language Artificial Intelligence Machine Learning Prompting large language models has gained immense popularity in recent years due to the advantage of producing good results even without the need for labelled data. However, this requires prompt tuning to get optimal prompts that lead to better model performances. In this paper, we explore the use of soft-prompt tuning on sentiment classification task to quantify the biases of large language models (LLMs) such as Open Pre-trained Transformers (OPT) and Galactica language model. Since these models are trained on real-world data that could be prone to bias toward certain groups of populations, it is important to identify these underlying issues. Using soft-prompts to evaluate bias gives us the extra advantage of avoiding the human-bias injection that can be caused by manually designed prompts. We check the model biases on different sensitive attributes using the group fairness (bias) and find interesting bias patterns. Since LLMs have been used in the industry in various applications, it is crucial to identify the biases before deploying these models in practice. We open-source our pipeline and encourage industry researchers to adapt our work to their use cases. |
| title | Soft-prompt Tuning for Large Language Models to Evaluate Bias |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2306.04735 |