Cover Image

RLKD: Distilling LLMs' Reasoning via Reinforcement Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Shicheng, Pang, Liang, Zhu, Yunchang, Gu, Jia, Wei, Zihao, Deng, Jingcheng, Pan, Feiyang, Shen, Huawei, Cheng, Xueqi
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Cross-Modal Safety Mechanism Transfer in Large Vision-Language Models
by: Xu, Shicheng, et al.
Published: (2024)

LLM Latent Reasoning as Chain of Superposition
by: Deng, Jingcheng, et al.
Published: (2025)

The Evolution of Thought: Tracking LLM Overthinking via Reasoning Dynamics Analysis
by: Wei, Zihao, et al.
Published: (2025)

Latent-GRPO: Group Relative Policy Optimization for Latent Reasoning
by: Deng, Jingcheng, et al.
Published: (2026)

Circular Reasoning: Understanding Self-Reinforcing Loops in Large Reasoning Models
by: Duan, Zenghao, et al.
Published: (2026)

Invisible Relevance Bias: Text-Image Retrieval Models Prefer AI-Generated Images
by: Xu, Shicheng, et al.
Published: (2023)

MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models
by: Wei, Zihao, et al.
Published: (2024)

Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Models
by: Deng, Jingcheng, et al.
Published: (2024)

Stable Knowledge Editing in Large Language Models
by: Wei, Zihao, et al.
Published: (2024)

A Theory for Token-Level Harmonization in Retrieval-Augmented Generation
by: Xu, Shicheng, et al.
Published: (2024)

Do LLMs Play Dice? Exploring Probability Distribution Sampling in Large Language Models for Behavioral Simulation
by: Gu, Jia, et al.
Published: (2024)

Reverse Physician-AI Relationship: Full-process Clinical Diagnosis Driven by a Large Language Model
by: Xu, Shicheng, et al.
Published: (2025)

Following the Autoregressive Nature of LLM Embeddings via Compression and Alignment
by: Deng, Jingcheng, et al.
Published: (2025)

Rowen: Adaptive Retrieval-Augmented Generation for Hallucination Mitigation in LLMs
by: Ding, Hanxing, et al.
Published: (2024)

List-aware Reranking-Truncation Joint Model for Search and Retrieval-augmented Generation
by: Xu, Shicheng, et al.
Published: (2024)

Cross-Model Comparative Loss for Enhancing Neuronal Utility in Language Understanding
by: Zhu, Yunchang, et al.
Published: (2023)

D-Models and E-Models: Diversity-Stability Trade-offs in the Sampling Behavior of Large Language Models
by: Gu, Jia, et al.
Published: (2026)

Search-in-the-Chain: Interactively Enhancing Large Language Models with Search for Knowledge-intensive Tasks
by: Xu, Shicheng, et al.
Published: (2023)

SkillAttack: Automated Red Teaming of Agent Skills through Attack Path Refinement
by: Duan, Zenghao, et al.
Published: (2026)

Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue
by: Zhou, Junkai, et al.
Published: (2023)

On the Diminishing Returns of Complex Robust RAG Training in the Era of Powerful LLMs
by: Ding, Hanxing, et al.
Published: (2025)

Unsupervised Information Refinement Training of Large Language Models for Retrieval-Augmented Generation
by: Xu, Shicheng, et al.
Published: (2024)

Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agent
by: Zhou, Junkai, et al.
Published: (2024)

Improving Video Corpus Moment Retrieval with Partial Relevance Enhancement
by: Hou, Danyang, et al.
Published: (2024)

Enhancing Training Data Attribution for Large Language Models with Fitting Error Consideration
by: Wu, Kangxi, et al.
Published: (2024)

Event-aware Video Corpus Moment Retrieval
by: Hou, Danyang, et al.
Published: (2024)

Generative Ghost: Investigating Ranking Bias Hidden in AI-Generated Videos
by: Gao, Haowen, et al.
Published: (2025)

ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models
by: Ding, Hanxing, et al.
Published: (2025)

Large Language Model Sourcing: A Survey
by: Pang, Liang, et al.
Published: (2025)

Qsnail: A Questionnaire Dataset for Sequential Question Generation
by: Lei, Yan, et al.
Published: (2024)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
by: Xu, Hongling, et al.
Published: (2025)

GloSS over Toxicity: Understanding and Mitigating Toxicity in LLMs via Global Toxic Subspace
by: Duan, Zenghao, et al.
Published: (2025)

Projecting Out the Malice: A Global Subspace Approach to LLM Detoxification
by: Duan, Zenghao, et al.
Published: (2026)

Negative as Positive: Enhancing Out-of-distribution Generalization for Graph Contrastive Learning
by: Wang, Zixu, et al.
Published: (2024)

InfoNCE is a Free Lunch for Semantically guided Graph Contrastive Learning
by: Wang, Zixu, et al.
Published: (2025)

Unlocking Reasoning Capabilities in LLMs via Reinforcement Learning Exploration
by: Deng, Wenhao, et al.
Published: (2025)

Beyond Reasoning: Reinforcement Learning Unlocks Parametric Knowledge in LLMs
by: Yang, Wanli, et al.
Published: (2026)

TEA: Test-time Energy Adaptation
by: Yuan, Yige, et al.
Published: (2023)

DIVA-GRPO: Enhancing Multimodal Reasoning through Difficulty-Adaptive Variant Advantage
by: Gao, Haowen, et al.
Published: (2026)

Native Parallel Reasoner: Reasoning in Parallelism via Self-Distilled Reinforcement Learning
by: Wu, Tong, et al.
Published: (2025)