Saved in:
Bibliographic Details
Main Author: Xie, Jiaqing
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.01246
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909820284567552
author Xie, Jiaqing
author_facet Xie, Jiaqing
contents Sparse autoencoders (SAEs) have recently emerged as a powerful tool for language model steering. Prior work has explored top-k SAE latents for steering, but we observe that many dimensions among the top-k latents capture non-semantic features such as punctuation rather than semantic attributes like instructions. To address this, we propose focusing on a single, most relevant SAE latent (top-1), eliminating redundant features. We further identify a limitation in constant SAE steering, which often produces degenerate outputs such as repetitive single words. To mitigate this, we introduce a token-wise decaying steering strategy, enabling more faithful comparisons with mean activation difference baselines. Empirically, we show that steering an SAE latent associated with reasoning reliably elicits step-by-step mathematical reasoning and enhances inference quality, functionally resembling the effect of appending a guiding token. Our results demonstrate that SAEs outperform mean activation difference methods on mathematical reasoning benchmarks and match their performance on IF-Eval.
format Preprint
id arxiv_https___arxiv_org_abs_2510_01246
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Comparative Analysis of Sparse Autoencoder and Activation Difference in Language Model Steering
Xie, Jiaqing
Computation and Language
Sparse autoencoders (SAEs) have recently emerged as a powerful tool for language model steering. Prior work has explored top-k SAE latents for steering, but we observe that many dimensions among the top-k latents capture non-semantic features such as punctuation rather than semantic attributes like instructions. To address this, we propose focusing on a single, most relevant SAE latent (top-1), eliminating redundant features. We further identify a limitation in constant SAE steering, which often produces degenerate outputs such as repetitive single words. To mitigate this, we introduce a token-wise decaying steering strategy, enabling more faithful comparisons with mean activation difference baselines. Empirically, we show that steering an SAE latent associated with reasoning reliably elicits step-by-step mathematical reasoning and enhances inference quality, functionally resembling the effect of appending a guiding token. Our results demonstrate that SAEs outperform mean activation difference methods on mathematical reasoning benchmarks and match their performance on IF-Eval.
title A Comparative Analysis of Sparse Autoencoder and Activation Difference in Language Model Steering
topic Computation and Language
url https://arxiv.org/abs/2510.01246