The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916635115257856 |
|---|---|
| author | Tang, Yihong Chen, Kehai Bai, Xuefeng Niu, Zhengyu Wang, Bo Liu, Jie Zhang, Min |
| author_facet | Tang, Yihong Chen, Kehai Bai, Xuefeng Niu, Zhengyu Wang, Bo Liu, Jie Zhang, Min |
| contents | Large Language Models (LLMs) have made remarkable advances in role-playing dialogue agents, demonstrating their utility in character simulations. However, it remains challenging for these agents to balance character portrayal utility with content safety because this essential character simulation often comes with the risk of generating unsafe content. To address this issue, we first conduct a systematic exploration of the safety-utility trade-off across multiple LLMs. Our analysis reveals that risk scenarios created by villain characters and user queries (referred to as risk coupling) contribute to this trade-off. Building on this, we propose a novel Adaptive Dynamic Multi-Preference (ADMP) method, which dynamically adjusts safety-utility preferences based on the degree of risk coupling and guides the model to generate responses biased toward utility or safety. We further introduce Coupling Margin Sampling (CMS) into coupling detection to enhance the model's ability to handle high-risk scenarios. Experimental results demonstrate that our approach improves safety metrics while maintaining utility. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_20757 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents Tang, Yihong Chen, Kehai Bai, Xuefeng Niu, Zhengyu Wang, Bo Liu, Jie Zhang, Min Computation and Language Large Language Models (LLMs) have made remarkable advances in role-playing dialogue agents, demonstrating their utility in character simulations. However, it remains challenging for these agents to balance character portrayal utility with content safety because this essential character simulation often comes with the risk of generating unsafe content. To address this issue, we first conduct a systematic exploration of the safety-utility trade-off across multiple LLMs. Our analysis reveals that risk scenarios created by villain characters and user queries (referred to as risk coupling) contribute to this trade-off. Building on this, we propose a novel Adaptive Dynamic Multi-Preference (ADMP) method, which dynamically adjusts safety-utility preferences based on the degree of risk coupling and guides the model to generate responses biased toward utility or safety. We further introduce Coupling Margin Sampling (CMS) into coupling detection to enhance the model's ability to handle high-risk scenarios. Experimental results demonstrate that our approach improves safety metrics while maintaining utility. |
| title | The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agents |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.20757 |