Controllable Value Alignment in Large Language Models through Neuron-Level Editing
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917551693365248 |
|---|---|
| author | Yang, Yonghui Wang, Yihui Li, Junwei Liu, Jilong Zhu, Fengbin Huang, Weibiao Wu, Le Hong, Richang Chua, Tat-Seng |
| author_facet | Yang, Yonghui Wang, Yihui Li, Junwei Liu, Jilong Zhu, Fengbin Huang, Weibiao Wu, Le Hong, Richang Chua, Tat-Seng |
| contents | Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from limited controllability: steering a target value often unintentionally activates other, non-target values. To characterize this limitation, we introduce value leakage, a diagnostic notion that captures the unintended activation of non-target values during value steering, along with a normalized leakage metric grounded in Schwartz's value theory. In light of this analysis, we propose NeVA, a neuron-level editing framework for controllable value alignment in LLMs. NeVA identifies sparse, value-relevant neurons and performs inference-time activation editing, enabling fine-grained control without parameter updates or retraining. Experiments show that NeVA achieves stronger target value alignment while incurring smaller performance degradation on general capability. Moreover, NeVA significantly reduces the average leakage, with residual effects largely confined to semantically related value classes. Overall, NeVA offers a more controllable and interpretable mechanism for value alignment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_07356 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Controllable Value Alignment in Large Language Models through Neuron-Level Editing Yang, Yonghui Wang, Yihui Li, Junwei Liu, Jilong Zhu, Fengbin Huang, Weibiao Wu, Le Hong, Richang Chua, Tat-Seng Machine Learning Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from limited controllability: steering a target value often unintentionally activates other, non-target values. To characterize this limitation, we introduce value leakage, a diagnostic notion that captures the unintended activation of non-target values during value steering, along with a normalized leakage metric grounded in Schwartz's value theory. In light of this analysis, we propose NeVA, a neuron-level editing framework for controllable value alignment in LLMs. NeVA identifies sparse, value-relevant neurons and performs inference-time activation editing, enabling fine-grained control without parameter updates or retraining. Experiments show that NeVA achieves stronger target value alignment while incurring smaller performance degradation on general capability. Moreover, NeVA significantly reduces the average leakage, with residual effects largely confined to semantically related value classes. Overall, NeVA offers a more controllable and interpretable mechanism for value alignment. |
| title | Controllable Value Alignment in Large Language Models through Neuron-Level Editing |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2602.07356 |