Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.13136 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913206692216832 |
|---|---|
| author | Shen, Lingfeng Tan, Weiting Chen, Sihao Chen, Yunmo Zhang, Jingyu Xu, Haoran Zheng, Boyuan Koehn, Philipp Khashabi, Daniel |
| author_facet | Shen, Lingfeng Tan, Weiting Chen, Sihao Chen, Yunmo Zhang, Jingyu Xu, Haoran Zheng, Boyuan Koehn, Philipp Khashabi, Daniel |
| contents | As the influence of large language models (LLMs) spans across global communities, their safety challenges in multilingual settings become paramount for alignment research. This paper examines the variations in safety challenges faced by LLMs across different languages and discusses approaches to alleviating such concerns. By comparing how state-of-the-art LLMs respond to the same set of malicious prompts written in higher- vs. lower-resource languages, we observe that (1) LLMs tend to generate unsafe responses much more often when a malicious prompt is written in a lower-resource language, and (2) LLMs tend to generate more irrelevant responses to malicious prompts in lower-resource languages. To understand where the discrepancy can be attributed, we study the effect of instruction tuning with reinforcement learning from human feedback (RLHF) or supervised finetuning (SFT) on the HH-RLHF dataset. Surprisingly, while training with high-resource languages improves model alignment, training in lower-resource languages yields minimal improvement. This suggests that the bottleneck of cross-lingual alignment is rooted in the pretraining stage. Our findings highlight the challenges in cross-lingual LLM safety, and we hope they inform future research in this direction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_13136 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contexts Shen, Lingfeng Tan, Weiting Chen, Sihao Chen, Yunmo Zhang, Jingyu Xu, Haoran Zheng, Boyuan Koehn, Philipp Khashabi, Daniel Computation and Language Artificial Intelligence As the influence of large language models (LLMs) spans across global communities, their safety challenges in multilingual settings become paramount for alignment research. This paper examines the variations in safety challenges faced by LLMs across different languages and discusses approaches to alleviating such concerns. By comparing how state-of-the-art LLMs respond to the same set of malicious prompts written in higher- vs. lower-resource languages, we observe that (1) LLMs tend to generate unsafe responses much more often when a malicious prompt is written in a lower-resource language, and (2) LLMs tend to generate more irrelevant responses to malicious prompts in lower-resource languages. To understand where the discrepancy can be attributed, we study the effect of instruction tuning with reinforcement learning from human feedback (RLHF) or supervised finetuning (SFT) on the HH-RLHF dataset. Surprisingly, while training with high-resource languages improves model alignment, training in lower-resource languages yields minimal improvement. This suggests that the bottleneck of cross-lingual alignment is rooted in the pretraining stage. Our findings highlight the challenges in cross-lingual LLM safety, and we hope they inform future research in this direction. |
| title | The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contexts |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2401.13136 |