Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.11036 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909463687987200 |
|---|---|
| author | Yang, Jingyuan Li, Rongjun Wang, Weixuan Zhou, Ziyu Feng, Zhiyong Peng, Wei |
| author_facet | Yang, Jingyuan Li, Rongjun Wang, Weixuan Zhou, Ziyu Feng, Zhiyong Peng, Wei |
| contents | Large Language Models (LLMs) often generate inconsistent responses when prompted with semantically equivalent paraphrased inputs. Recently, activation steering, a technique that modulates LLMs' behaviours by adjusting their latent representations during inference time, has been explored to improve the semantic consistency of LLMs. However, these methods typically operate at the model component level, such as layer hidden states or attention head outputs. They face a challenge due to the ``polysemanticity issue'', where the model components of LLMs typically encode multiple entangled features, making precise steering difficult. To address this challenge, we drill down to feature-level representations and propose LF-Steering, a novel activation steering approach to precisely identify latent feature representations responsible for semantic inconsistency. More specifically, our method maps the hidden states of the relevant transformer layer into a sparsely activated, high-dimensional feature space based on a sparse autoencoder (SAE), ensuring model steering based on decoupled feature representations with minimal interference. Comprehensive experiments on NLU and NLG datasets demonstrate the effectiveness of our method in enhancing semantic consistency, resulting in significant performance gains for various NLU and NLG tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_11036 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Models Yang, Jingyuan Li, Rongjun Wang, Weixuan Zhou, Ziyu Feng, Zhiyong Peng, Wei Computation and Language Large Language Models (LLMs) often generate inconsistent responses when prompted with semantically equivalent paraphrased inputs. Recently, activation steering, a technique that modulates LLMs' behaviours by adjusting their latent representations during inference time, has been explored to improve the semantic consistency of LLMs. However, these methods typically operate at the model component level, such as layer hidden states or attention head outputs. They face a challenge due to the ``polysemanticity issue'', where the model components of LLMs typically encode multiple entangled features, making precise steering difficult. To address this challenge, we drill down to feature-level representations and propose LF-Steering, a novel activation steering approach to precisely identify latent feature representations responsible for semantic inconsistency. More specifically, our method maps the hidden states of the relevant transformer layer into a sparsely activated, high-dimensional feature space based on a sparse autoencoder (SAE), ensuring model steering based on decoupled feature representations with minimal interference. Comprehensive experiments on NLU and NLG datasets demonstrate the effectiveness of our method in enhancing semantic consistency, resulting in significant performance gains for various NLU and NLG tasks. |
| title | LF-Steering: Latent Feature Activation Steering for Enhancing Semantic Consistency in Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2501.11036 |