On the transferability of Sparse Autoencoders for interpreting compressed models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916855366549504 |
|---|---|
| author | Gupte, Suchit Chhabra, Vishnu Kabir Khalili, Mohammad Mahdi |
| author_facet | Gupte, Suchit Chhabra, Vishnu Kabir Khalili, Mohammad Mahdi |
| contents | Modern LLMs face inference efficiency challenges due to their scale. To address this, many compression methods have been proposed, such as pruning and quantization. However, the effect of compression on a model's interpretability remains elusive. While several model interpretation approaches exist, such as circuit discovery, Sparse Autoencoders (SAEs) have proven particularly effective in decomposing a model's activation space into its feature basis. In this work, we explore the differences in SAEs for the original and compressed models. We find that SAEs trained on the original model can interpret the compressed model albeit with slight performance degradation compared to the trained SAE on the compressed model. Furthermore, simply pruning the original SAE itself achieves performance comparable to training a new SAE on the pruned model. This finding enables us to mitigate the extensive training costs of SAEs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_15977 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the transferability of Sparse Autoencoders for interpreting compressed models Gupte, Suchit Chhabra, Vishnu Kabir Khalili, Mohammad Mahdi Machine Learning Artificial Intelligence Modern LLMs face inference efficiency challenges due to their scale. To address this, many compression methods have been proposed, such as pruning and quantization. However, the effect of compression on a model's interpretability remains elusive. While several model interpretation approaches exist, such as circuit discovery, Sparse Autoencoders (SAEs) have proven particularly effective in decomposing a model's activation space into its feature basis. In this work, we explore the differences in SAEs for the original and compressed models. We find that SAEs trained on the original model can interpret the compressed model albeit with slight performance degradation compared to the trained SAE on the compressed model. Furthermore, simply pruning the original SAE itself achieves performance comparable to training a new SAE on the pruned model. This finding enables us to mitigate the extensive training costs of SAEs. |
| title | On the transferability of Sparse Autoencoders for interpreting compressed models |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2507.15977 |