Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914108437168128 |
|---|---|
| author | In, Yeonjun Kim, Wonjoong Yoon, Kanghoon Kim, Sungchul Tanjim, Mehrab Park, Sangwu Kim, Kibum Park, Chanyoung |
| author_facet | In, Yeonjun Kim, Wonjoong Yoon, Kanghoon Kim, Sungchul Tanjim, Mehrab Park, Sangwu Kim, Kibum Park, Chanyoung |
| contents | As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of LLM safety by defining the safety relying heavily on general standards, overlooking user-specific standards. However, safety standards for LLM may vary based on a user-specific profiles rather than being universally consistent across all users. This raises a critical research question: Do LLM agents act safely when considering user-specific safety standards? Despite its importance for safe LLM use, no benchmark datasets currently exist to evaluate the user-specific safety of LLMs. To address this gap, we introduce U-SafeBench, a benchmark designed to assess user-specific aspect of LLM safety. Our evaluation of 20 widely used LLMs reveals current LLMs fail to act safely when considering user-specific safety standards, marking a new discovery in this field. To address this vulnerability, we propose a simple remedy based on chain-of-thought, demonstrating its effectiveness in improving user-specific safety. Our benchmark and code are available at https://github.com/yeonjun-in/U-SafeBench. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_15086 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models In, Yeonjun Kim, Wonjoong Yoon, Kanghoon Kim, Sungchul Tanjim, Mehrab Park, Sangwu Kim, Kibum Park, Chanyoung Computation and Language As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of LLM safety by defining the safety relying heavily on general standards, overlooking user-specific standards. However, safety standards for LLM may vary based on a user-specific profiles rather than being universally consistent across all users. This raises a critical research question: Do LLM agents act safely when considering user-specific safety standards? Despite its importance for safe LLM use, no benchmark datasets currently exist to evaluate the user-specific safety of LLMs. To address this gap, we introduce U-SafeBench, a benchmark designed to assess user-specific aspect of LLM safety. Our evaluation of 20 widely used LLMs reveals current LLMs fail to act safely when considering user-specific safety standards, marking a new discovery in this field. To address this vulnerability, we propose a simple remedy based on chain-of-thought, demonstrating its effectiveness in improving user-specific safety. Our benchmark and code are available at https://github.com/yeonjun-in/U-SafeBench. |
| title | Is Safety Standard Same for Everyone? User-Specific Safety Evaluation of Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.15086 |