Saved in:
Bibliographic Details
Main Authors: Sun, Jie, Zheng, Mao, Song, Mingyang, Zhong, Qiyong, Cheng, Yilin, Feng, Bichuan, Liu, Pengfei, Fang, Junfeng, Wang, Xiang
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.07711
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918516073955328
author Sun, Jie
Zheng, Mao
Song, Mingyang
Zhong, Qiyong
Cheng, Yilin
Feng, Bichuan
Liu, Pengfei
Fang, Junfeng
Wang, Xiang
author_facet Sun, Jie
Zheng, Mao
Song, Mingyang
Zhong, Qiyong
Cheng, Yilin
Feng, Bichuan
Liu, Pengfei
Fang, Junfeng
Wang, Xiang
contents On-policy distillation (OPD) is a standard tool for transferring teacher behavior to a smaller student, but it implicitly assumes that teacher and student predictions are comparable token by token, an assumption that fails whenever the two models tokenize the same text differently. Under heterogeneous tokenizers, exact shared-token matching silently discards a large fraction of the teacher signal at precisely the positions where vocabularies disagree. We propose \textbf{\underline{Sim}ple \underline{C}ross-\underline{T}okenizer OPD (SimCT)}, which restores this signal by enlarging the supervision space: alongside shared tokens, SimCT compares teacher and student over short multi-token continuations that both tokenizers can realize, leaving the OPD loss form itself unchanged. We show that these units are the finest jointly tokenizable supervision interface, and that coarser alternatives remove teacher-student distinctions that are useful for on-policy learning. Across three heterogeneous teacher-student pairs on mathematical reasoning and code-generation benchmarks, SimCT shows consistent gains over shared-vocabulary OPD and representative cross-tokenizer baselines, with ablations confirming that the improvements come from recovering supervision discarded by exact shared-token matching. Code is available at \href{https://github.com/sunjie279/SimCT-}{https://github.com/sunjie279/SimCT-}.
format Preprint
id arxiv_https___arxiv_org_abs_2605_07711
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation
Sun, Jie
Zheng, Mao
Song, Mingyang
Zhong, Qiyong
Cheng, Yilin
Feng, Bichuan
Liu, Pengfei
Fang, Junfeng
Wang, Xiang
Computation and Language
On-policy distillation (OPD) is a standard tool for transferring teacher behavior to a smaller student, but it implicitly assumes that teacher and student predictions are comparable token by token, an assumption that fails whenever the two models tokenize the same text differently. Under heterogeneous tokenizers, exact shared-token matching silently discards a large fraction of the teacher signal at precisely the positions where vocabularies disagree. We propose \textbf{\underline{Sim}ple \underline{C}ross-\underline{T}okenizer OPD (SimCT)}, which restores this signal by enlarging the supervision space: alongside shared tokens, SimCT compares teacher and student over short multi-token continuations that both tokenizers can realize, leaving the OPD loss form itself unchanged. We show that these units are the finest jointly tokenizable supervision interface, and that coarser alternatives remove teacher-student distinctions that are useful for on-policy learning. Across three heterogeneous teacher-student pairs on mathematical reasoning and code-generation benchmarks, SimCT shows consistent gains over shared-vocabulary OPD and representative cross-tokenizer baselines, with ablations confirming that the improvements come from recovering supervision discarded by exact shared-token matching. Code is available at \href{https://github.com/sunjie279/SimCT-}{https://github.com/sunjie279/SimCT-}.
title SimCT: Recovering Lost Supervision for Cross-Tokenizer On-Policy Distillation
topic Computation and Language
url https://arxiv.org/abs/2605.07711