TroubleLLM: Align to Red Team Expert
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911787679481856 |
|---|---|
| author | Xu, Zhuoer Zhang, Jianping Cui, Shiwen Meng, Changhua Wang, Weiqiang |
| author_facet | Xu, Zhuoer Zhang, Jianping Cui, Shiwen Meng, Changhua Wang, Weiqiang |
| contents | Large Language Models (LLMs) become the start-of-the-art solutions for a variety of natural language tasks and are integrated into real-world applications. However, LLMs can be potentially harmful in manifesting undesirable safety issues like social biases and toxic content. It is imperative to assess its safety issues before deployment. However, the quality and diversity of test prompts generated by existing methods are still far from satisfactory. Not only are these methods labor-intensive and require large budget costs, but the controllability of test prompt generation is lacking for the specific testing domain of LLM applications. With the idea of LLM for LLM testing, we propose the first LLM, called TroubleLLM, to generate controllable test prompts on LLM safety issues. Extensive experiments and human evaluation illustrate the superiority of TroubleLLM on generation quality and generation controllability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_00829 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TroubleLLM: Align to Red Team Expert Xu, Zhuoer Zhang, Jianping Cui, Shiwen Meng, Changhua Wang, Weiqiang Artificial Intelligence Computation and Language Large Language Models (LLMs) become the start-of-the-art solutions for a variety of natural language tasks and are integrated into real-world applications. However, LLMs can be potentially harmful in manifesting undesirable safety issues like social biases and toxic content. It is imperative to assess its safety issues before deployment. However, the quality and diversity of test prompts generated by existing methods are still far from satisfactory. Not only are these methods labor-intensive and require large budget costs, but the controllability of test prompt generation is lacking for the specific testing domain of LLM applications. With the idea of LLM for LLM testing, we propose the first LLM, called TroubleLLM, to generate controllable test prompts on LLM safety issues. Extensive experiments and human evaluation illustrate the superiority of TroubleLLM on generation quality and generation controllability. |
| title | TroubleLLM: Align to Red Team Expert |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2403.00829 |