Image de couverture de livre

Distilling Mathematical Reasoning Capabilities into Small Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhu, Xunyu, Li, Jian, Liu, Yong, Ma, Can, Wang, Weiping
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Improving Mathematical Reasoning Capabilities of Small Language Models via Feedback-Driven Distillation
par: Zhu, Xunyu, et autres
Publié: (2024)

Key-Point-Driven Mathematical Reasoning Distillation of Large Language Model
par: Zhu, Xunyu, et autres
Publié: (2024)

A Survey on Model Compression for Large Language Models
par: Zhu, Xunyu, et autres
Publié: (2023)

Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring
par: Guan, Weixin, et autres
Publié: (2026)

HintMR: Eliciting Stronger Mathematical Reasoning in Small Language Models
par: Hossain, Jawad, et autres
Publié: (2026)

Olapa-MCoT: Enhancing the Chinese Mathematical Reasoning Capability of LLMs
par: Zhu, Shaojie, et autres
Publié: (2023)

A Survey on Large Language Models for Mathematical Reasoning
par: Wang, Peng-Yuan, et autres
Publié: (2025)

InfiR : Crafting Effective Small Language Models and Multimodal Small Language Models in Reasoning
par: Xie, Congkai, et autres
Publié: (2025)

Token-Supervised Value Models for Enhancing Mathematical Problem-Solving Capabilities of Large Language Models
par: Lee, Jung Hyun, et autres
Publié: (2024)

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
par: Wang, Jingyuan, et autres
Publié: (2025)

Confidence-Calibrated Small-Large Language Model Collaboration for Cost-Efficient Reasoning
par: Zhang, Chuang, et autres
Publié: (2026)

Mixed Distillation Helps Smaller Language Model Better Reasoning
par: Li, Chenglin, et autres
Publié: (2023)

ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging
par: Yang, Junyao, et autres
Publié: (2026)

Cooperative Strategic Planning Enhances Reasoning Capabilities in Large Language Models
par: Wang, Danqing, et autres
Publié: (2024)

PDDL-Mind: Large Language Models are Capable on Belief Reasoning with Reliable State Tracking
par: Zhu, Wang Bill, et autres
Publié: (2026)

UGMathBench: A Diverse and Dynamic Benchmark for Undergraduate-Level Mathematical Reasoning with Large Language Models
par: Xu, Xin, et autres
Publié: (2025)

Can Large Models Teach Student Models to Solve Mathematical Problems Like Human Beings? A Reasoning Distillation Method via Multi-LoRA Interaction
par: Li, Xinhe, et autres
Publié: (2025)

Efficient Long CoT Reasoning in Small Language Models
par: Wang, Zhaoyang, et autres
Publié: (2025)

Capturing Nuanced Preferences: Preference-Aligned Distillation for Small Language Models
par: Gu, Yanggan, et autres
Publié: (2025)

Self-Evolved Preference Optimization for Enhancing Mathematical Reasoning in Small Language Models
par: Singh, Joykirat, et autres
Publié: (2025)

ReAD: Reinforcement-Guided Capability Distillation for Large Language Models
par: Cheng, Xueqi, et autres
Publié: (2026)

Dynamic Early Exit in Reasoning Models
par: Yang, Chenxu, et autres
Publié: (2025)

Evaluating Consistency and Reasoning Capabilities of Large Language Models
par: Saxena, Yash, et autres
Publié: (2024)

PARAMANU-GANITA: Can Small Math Language Models Rival with Large Language Models on Mathematical Reasoning?
par: Niyogi, Mitodru, et autres
Publié: (2024)

Reasoning Capabilities of Large Language Models on Dynamic Tasks
par: Wong, Annie, et autres
Publié: (2025)

Reinforcement Learning vs. Distillation: Understanding Accuracy and Capability in LLM Reasoning
par: Kim, Minwu, et autres
Publié: (2025)

From Next-Token to Mathematics: The Learning Dynamics of Mathematical Reasoning in Language Models
par: Mishra, Shubhra, et autres
Publié: (2024)

SOD: Step-wise On-policy Distillation for Small Language Model Agents
par: Zhong, Qiyong, et autres
Publié: (2026)

Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities
par: Hua, Wenyue, et autres
Publié: (2024)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
par: Li, Ce, et autres
Publié: (2025)

Route-and-Reason: Scaling Large Language Model Reasoning with Reinforced Model Router
par: Shao, Chenyang, et autres
Publié: (2025)

JiuZhang3.0: Efficiently Improving Mathematical Reasoning by Training Small Data Synthesis Models
par: Zhou, Kun, et autres
Publié: (2024)

SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities
par: Jiang, Fengqing, et autres
Publié: (2025)

Unlocking Reasoning Capability on Machine Translation in Large Language Models
par: Rajaee, Sara, et autres
Publié: (2026)

CHANCERY: Evaluating Corporate Governance Reasoning Capabilities in Language Models
par: Irwin, Lucas, et autres
Publié: (2025)

MedCritical: Enhancing Medical Reasoning in Small Language Models via Self-Collaborative Correction
par: Su, Xinchun, et autres
Publié: (2025)

Schoenfeld's Anatomy of Mathematical Reasoning by Language Models
par: Li, Ming, et autres
Publié: (2025)

GAUSS: Benchmarking Structured Mathematical Skills for Large Language Models
par: Zhang, Yue, et autres
Publié: (2025)

Simulated Annealing Enhances Theory-of-Mind Reasoning in Autoregressive Language Models
par: Hu, Xucong, et autres
Publié: (2026)

Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation
par: Cheng, Zihao, et autres
Publié: (2026)