Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2605.01167 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909009863245824 |
|---|---|
| author | Nguyen, Tam Nguyen, Tu Anh Alemohammad, Sina Baraniuk, Richard G. |
| author_facet | Nguyen, Tam Nguyen, Tu Anh Alemohammad, Sina Baraniuk, Richard G. |
| contents | Activation steering is a method for controlling Large Language Model (LLM) behavior by intervening in its internal representations to increase the alignment with a specific target feature direction. However, standard interventions, such as vector addition, often cause ``collateral damage", defined as unintended changes in the alignment of activations along other non-target feature directions. This damage occurs because standard methods implicitly assume the isotropy of non-target features. In this work, we provide a mathematical formalization of collateral damage and introduce a principled framework that models steering as a constrained optimization problem. Our method finds a new activation that minimizes the expected squared collateral change weighted by the empirical second-moment matrix of activations. This weighting encodes the nonuniform cost of the perturbation in different feature directions, in contrast to isotropic approaches that penalize changes uniformly in all feature directions. By accounting for the empirical second-moment of activations, our approach achieves more precise control while reducing the degradation of model performance on unrelated tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_01167 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Minimizing Collateral Damage in Activation Steering Nguyen, Tam Nguyen, Tu Anh Alemohammad, Sina Baraniuk, Richard G. Machine Learning Artificial Intelligence Activation steering is a method for controlling Large Language Model (LLM) behavior by intervening in its internal representations to increase the alignment with a specific target feature direction. However, standard interventions, such as vector addition, often cause ``collateral damage", defined as unintended changes in the alignment of activations along other non-target feature directions. This damage occurs because standard methods implicitly assume the isotropy of non-target features. In this work, we provide a mathematical formalization of collateral damage and introduce a principled framework that models steering as a constrained optimization problem. Our method finds a new activation that minimizes the expected squared collateral change weighted by the empirical second-moment matrix of activations. This weighting encodes the nonuniform cost of the perturbation in different feature directions, in contrast to isotropic approaches that penalize changes uniformly in all feature directions. By accounting for the empirical second-moment of activations, our approach achieves more precise control while reducing the degradation of model performance on unrelated tasks. |
| title | Minimizing Collateral Damage in Activation Steering |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2605.01167 |