Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2601.06226 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912814135771136 |
|---|---|
| author | Duan, Zenghao Yin, Zhiyi Shi, Zhichao Pang, Liang Jing, Shaoling Huang, Zihe Wu, Jiayi Yan, Yu Deng, Jingcheng Shen, Huawei Cheng, Xueqi |
| author_facet | Duan, Zenghao Yin, Zhiyi Shi, Zhichao Pang, Liang Jing, Shaoling Huang, Zihe Wu, Jiayi Yan, Yu Deng, Jingcheng Shen, Huawei Cheng, Xueqi |
| contents | Large language models (LLMs) exhibit exceptional performance but pose inherent risks of generating toxic content, restricting their safe deployment. While traditional methods (e.g., alignment) adjust output preferences, they fail to eliminate underlying toxic regions in parameters, leaving models vulnerable to adversarial attacks. Prior mechanistic studies characterize toxic regions as "toxic vectors" or "layer-wise subspaces", yet our analysis identifies critical limitations: i) Removed toxic vectors can be reconstructed via linear combinations of non-toxic vectors, demanding targeting of entire toxic subspace; ii) Contrastive objective over limited samples inject noise into layer-wise subspaces, hindering stable extraction. These highlight the challenge of identifying robust toxic subspace and removing them. Therefore, we propose GLOSS (GLobal tOxic Subspace Suppression), a lightweight method that mitigates toxicity by identifying and eliminating this global subspace from FFN parameters. Experiments on LLMs (e.g., Qwen3) show GLOSS achieves SOTA detoxification while preserving general capabilities without requiring large-scale retraining. WARNING: This paper contains context which is toxic in nature. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_06226 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Projecting Out the Malice: A Global Subspace Approach to LLM Detoxification Duan, Zenghao Yin, Zhiyi Shi, Zhichao Pang, Liang Jing, Shaoling Huang, Zihe Wu, Jiayi Yan, Yu Deng, Jingcheng Shen, Huawei Cheng, Xueqi Machine Learning Artificial Intelligence Large language models (LLMs) exhibit exceptional performance but pose inherent risks of generating toxic content, restricting their safe deployment. While traditional methods (e.g., alignment) adjust output preferences, they fail to eliminate underlying toxic regions in parameters, leaving models vulnerable to adversarial attacks. Prior mechanistic studies characterize toxic regions as "toxic vectors" or "layer-wise subspaces", yet our analysis identifies critical limitations: i) Removed toxic vectors can be reconstructed via linear combinations of non-toxic vectors, demanding targeting of entire toxic subspace; ii) Contrastive objective over limited samples inject noise into layer-wise subspaces, hindering stable extraction. These highlight the challenge of identifying robust toxic subspace and removing them. Therefore, we propose GLOSS (GLobal tOxic Subspace Suppression), a lightweight method that mitigates toxicity by identifying and eliminating this global subspace from FFN parameters. Experiments on LLMs (e.g., Qwen3) show GLOSS achieves SOTA detoxification while preserving general capabilities without requiring large-scale retraining. WARNING: This paper contains context which is toxic in nature. |
| title | Projecting Out the Malice: A Global Subspace Approach to LLM Detoxification |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2601.06226 |