Cover Image

Fast and Effective On-policy Distillation from Reasoning Prefixes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Dongxu, Yang, Zhichao, Janghorbani, Sepehr, Han, Jun, Ressler II, Andrew, Qian, Qian, Lyng, Gregory D., Batra, Sanjit Singh, Tillman, Robert E.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs
by: Yang, Zhichao, et al.
Published: (2026)

MedicalBench: Evaluating Large Language Models Toward Improved Medical Concept Extraction
by: Yang, Zhichao, et al.
Published: (2026)

ESTAR: Early-Stopping Token-Aware Reasoning For Efficient Inference
by: Wang, Junda, et al.
Published: (2026)

POET: Protocol Optimization via Eligibility Tuning
by: Das, Trisha, et al.
Published: (2026)

MedFabric and EtHER: A Data-Centric Framework for Word-Level Fabrication Generation and Detection in Medical LLMs
by: Kwok, Tung Sum Thomas, et al.
Published: (2026)

Imputation of Unknown Missingness in Sparse Electronic Health Records
by: Han, Jun, et al.
Published: (2026)

Long-Chain Reasoning Distillation via Adaptive Prefix Alignment
by: Liu, Zhenghao, et al.
Published: (2026)

Organic aerosol-water interactions
by: Prisle, Nønne Lyng
Published: (2009)

PrefixGPT: Prefix Adder Optimization by a Generative Pre-trained Transformer
by: Ding, Ruogu, et al.
Published: (2025)

Bias-Restrained Prefix Representation Finetuning for Mathematical Reasoning
by: Liang, Sirui, et al.
Published: (2025)

La patata original
by: Ressler, Katherine
Published: (2006)

A Fast Algorithm for Computing Prefix Probabilities
by: Nowak, Franz, et al.
Published: (2023)

How Prime Factors Form Fractals
by: Tillman, Micah D.
Published: (2025)

PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning
by: Feng, Ruixiang, et al.
Published: (2026)

Prefix Teach, Suffix Fade: Local Teachability Collapse in Strong-to-Weak On-Policy Distillation
by: Liu, Kaiyuan, et al.
Published: (2026)

Thinking-Free Policy Initialization Makes Distilled Reasoning Models More Effective and Efficient Reasoners
by: Xu, Xin, et al.
Published: (2025)

How Does Prefix Matter in Reasoning Model Tuning?
by: Tomar, Raj Vardhan, et al.
Published: (2026)

PrefixMemory-Tuning: Modernizing Prefix-Tuning by Decoupling the Prefix from Attention
by: Wang, Haonan, et al.
Published: (2025)

Perceptions of homelessness: Is there variation across medical careers and specialties?
by: David Bronstein, et al.
Published: (2024)

Effective Distillation of Table-based Reasoning Ability from LLMs
by: Yang, Bohao, et al.
Published: (2023)

Health Education and Promotion for Minorities, No. 88-20. Current Bibliographies in Medicine.
by: Tillman, Peggie S.
Published: (1988)

Attribution of responsibility by Spanish and English speakers: How native language affects our social judgments
by: Richard Tillman
Published: (2013)

PrefixAgent: An LLM-Powered Design Framework for Efficient Prefix Adder Optimization
by: Zuo, Dongsheng, et al.
Published: (2025)

Well Begun, Half Done: Reinforcement Learning with Prefix Optimization for LLM Reasoning
by: Sun, Yiliu, et al.
Published: (2025)

Effects of Varying Levels of Distillers Dried Grains with Solubles on Growth Performance of Broiler Chicks
by: II RE Loar
Published: (2011)

ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging
by: Yang, Junyao, et al.
Published: (2026)

An Improved Fully Dynamic Algorithm for Counting 4-Cycles in General Graphs using Fast Matrix Multiplication
by: Assadi, Sepehr, et al.
Published: (2025)

The First Few Tokens Are All You Need: An Efficient and Effective Unsupervised Prefix Fine-Tuning Method for Reasoning Models
by: Ji, Ke, et al.
Published: (2025)

d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation
by: Qian, Yu-Yang, et al.
Published: (2026)

Shock in Adult‐Onset Still’s Disease Complicated by Macrophage Activation Syndrome: Clinical Characteristics and Prognosis of 14 Patients
by: Dongxu Li, et al.
Published: (2025)

CrossTrace: A Cross-Domain Dataset of Grounded Scientific Reasoning Traces for Hypothesis Generation
by: Bouras, Andrew, et al.
Published: (2026)

LLM-MRD: LLM-Guided Multi-View Reasoning Distillation for Fake News Detection
by: Zhou, Weilin, et al.
Published: (2026)

Bifurcated Attention: Accelerating Massively Parallel Decoding with Shared Prefixes in LLMs
by: Athiwaratkun, Ben, et al.
Published: (2024)

Device Context Protocol: A Compact, Safety-First Architecture for LLM-Driven Control of Constrained Devices
by: Yang, Dongxu
Published: (2026)

Enhancement of Effective Energy Barrier and Magnetic Blocking Temperature in Tetraoxolene Radical Coupled Dinuclear Dysprosium Complex
by: Pradip Kumar Sahu, et al.
Published: (2024)

PrefixLLM: LLM-aided Prefix Circuit Design
by: Xiao, Weihua, et al.
Published: (2024)

LLM Query Scheduling with Prefix Reuse and Latency Constraints
by: Dexter, Gregory, et al.
Published: (2025)

Environmental Engagement: An Effective Way in Mitigation of Firms' Litigation Risks in China
by: Qian Tao, et al.
Published: (2025)

The Path of Least Resistance: Guiding LLM Reasoning Trajectories with Prefix Consensus
by: Jindal, Ishan, et al.
Published: (2026)

Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning
by: Kim, Minwu, et al.
Published: (2026)