Saved in:
Bibliographic Details
Main Authors: Song, Shixiang, Li, He, Wang, Zitong, Zeng, Boyi, Song, Feichen, Wang, Yixuan, Xu, Zhiqin John, He, Ziwei, Lin, Zhouhan
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.01914
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912961042317312
author Song, Shixiang
Li, He
Wang, Zitong
Zeng, Boyi
Song, Feichen
Wang, Yixuan
Xu, Zhiqin John
He, Ziwei
Lin, Zhouhan
author_facet Song, Shixiang
Li, He
Wang, Zitong
Zeng, Boyi
Song, Feichen
Wang, Yixuan
Xu, Zhiqin John
He, Ziwei
Lin, Zhouhan
contents Test-time scaling via recurrent/iterative Transformers enables large language models to spend more computation at inference, but most pretrained recurrent LMs run a fixed number of iterations, wasting compute on easy tokens and lacking token-wise adaptivity. Following the core idea of Adaptive Computation Time(ACT) and Early Exit(EE), we propose AdaPonderLM, a self-supervised recurrent language model that learns token-wise early exiting during pretraining without manually tuned per-token/per-layer pruning ratios. AdaPonderLM uses iteration-specific MLP gates with a monotonic halting mask to decide when each token stops recurring, and introduces a KV reuse mechanism that reuses cached key/value states for halted tokens, ensuring train--test consistency and practical acceleration. Across Pythia backbones from 70M to 410M (pretraining) and up to 2.8B (continued pretraining), AdaPonderLM reduces inference compute at about 10% while maintaining comparable language modeling perplexity and competitive downstream accuracy. Our analysis shows the learned gates allocate more computation to high-NLL (hard) tokens, exhibiting adaptive computation time behavior in a fully self-supervised setting. Meanwhile, under iso-FLOPs, the learned halting policy consistently outperforms fixed pruning, showing AdaPonderLM allocates compute to the right tokens rather than just reducing average depth.
format Preprint
id arxiv_https___arxiv_org_abs_2603_01914
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle AdaPonderLM: Gated Pondering Language Models with Token-Wise Adaptive Depth
Song, Shixiang
Li, He
Wang, Zitong
Zeng, Boyi
Song, Feichen
Wang, Yixuan
Xu, Zhiqin John
He, Ziwei
Lin, Zhouhan
Computation and Language
Test-time scaling via recurrent/iterative Transformers enables large language models to spend more computation at inference, but most pretrained recurrent LMs run a fixed number of iterations, wasting compute on easy tokens and lacking token-wise adaptivity. Following the core idea of Adaptive Computation Time(ACT) and Early Exit(EE), we propose AdaPonderLM, a self-supervised recurrent language model that learns token-wise early exiting during pretraining without manually tuned per-token/per-layer pruning ratios. AdaPonderLM uses iteration-specific MLP gates with a monotonic halting mask to decide when each token stops recurring, and introduces a KV reuse mechanism that reuses cached key/value states for halted tokens, ensuring train--test consistency and practical acceleration. Across Pythia backbones from 70M to 410M (pretraining) and up to 2.8B (continued pretraining), AdaPonderLM reduces inference compute at about 10% while maintaining comparable language modeling perplexity and competitive downstream accuracy. Our analysis shows the learned gates allocate more computation to high-NLL (hard) tokens, exhibiting adaptive computation time behavior in a fully self-supervised setting. Meanwhile, under iso-FLOPs, the learned halting policy consistently outperforms fixed pruning, showing AdaPonderLM allocates compute to the right tokens rather than just reducing average depth.
title AdaPonderLM: Gated Pondering Language Models with Token-Wise Adaptive Depth
topic Computation and Language
url https://arxiv.org/abs/2603.01914