Delta-Crosscoder: Robust Crosscoder Model Diffing in Narrow Fine-Tuning Regimes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kassem, Aly, Jiralerspong, Thomas, Rostamzadeh, Negar, Farnadi, Golnoosh
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915834993049600
author Kassem, Aly
Jiralerspong, Thomas
Rostamzadeh, Negar
Farnadi, Golnoosh
author_facet Kassem, Aly
Jiralerspong, Thomas
Rostamzadeh, Negar
Farnadi, Golnoosh
contents Model diffing methods aim to identify how fine-tuning changes a model's internal representations. Crosscoders approach this by learning shared dictionaries of interpretable latent directions between base and fine-tuned models. However, existing formulations struggle with narrow fine-tuning, where behavioral changes are localized and asymmetric. We introduce Delta-Crosscoder, which combines BatchTopK sparsity with a delta-based loss prioritizing directions that change between models, plus an implicit contrastive signal from paired activations on matched inputs. Evaluated across 10 model organisms, including synthetic false facts, emergent misalignment, subliminal learning, and taboo word guessing (Gemma, LLaMA, Qwen; 1B-9B parameters), Delta-Crosscoder reliably isolates latent directions causally responsible for fine-tuned behaviors and enables effective mitigation, outperforming SAE-based baselines, while matching the Non-SAE-based. Our results demonstrate that crosscoders remain a powerful tool for model diffing.
format Preprint
id arxiv_https___arxiv_org_abs_2603_04426
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Delta-Crosscoder: Robust Crosscoder Model Diffing in Narrow Fine-Tuning Regimes
Kassem, Aly
Jiralerspong, Thomas
Rostamzadeh, Negar
Farnadi, Golnoosh
Machine Learning
Artificial Intelligence
Model diffing methods aim to identify how fine-tuning changes a model's internal representations. Crosscoders approach this by learning shared dictionaries of interpretable latent directions between base and fine-tuned models. However, existing formulations struggle with narrow fine-tuning, where behavioral changes are localized and asymmetric. We introduce Delta-Crosscoder, which combines BatchTopK sparsity with a delta-based loss prioritizing directions that change between models, plus an implicit contrastive signal from paired activations on matched inputs. Evaluated across 10 model organisms, including synthetic false facts, emergent misalignment, subliminal learning, and taboo word guessing (Gemma, LLaMA, Qwen; 1B-9B parameters), Delta-Crosscoder reliably isolates latent directions causally responsible for fine-tuned behaviors and enables effective mitigation, outperforming SAE-based baselines, while matching the Non-SAE-based. Our results demonstrate that crosscoders remain a powerful tool for model diffing.
title Delta-Crosscoder: Robust Crosscoder Model Diffing in Narrow Fine-Tuning Regimes
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2603.04426