TIP: Token Importance in On-Policy Distillation

Documenti analoghi

• Beyond GRPO and On-Policy Distillation: An Empirical Sparse-to-Dense Reward Principle for Language-Model Post-Training
  di: Xu, Yuanda, et al.
  Pubblicazione: (2026)
• PACED: Distillation and On-Policy Self-Distillation at the Frontier of Student Competence
  di: Xu, Yuanda, et al.
  Pubblicazione: (2026)
• Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning
  di: Xu, Yuanda, et al.
  Pubblicazione: (2026)
• Not all tokens are needed(NAT): token efficient reinforcement learning
  di: Sang, Hejian, et al.
  Pubblicazione: (2026)
• CRISP: Compressed Reasoning via Iterative Self-Policy Distillation
  di: Sang, Hejian, et al.
  Pubblicazione: (2026)