Cover Image

Effective Learning for Small Reasoning Models: An Empirical Study on 0.5B Reasoning LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhuang, Xialie, Ma, Peixian, Jia, Zhikai, Cao, Zane, Liu, Shiwei
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learning
by: Ma, Peixian, et al.
Published: (2025)

The Thinking Spectrum: An Empirical Study of Tunable Reasoning in LLMs through Model Merging
by: Lan, Xiaochong, et al.
Published: (2025)

An Empirical Study of Reasoning Steps in Thinking Code LLMs
by: Xue, Haoran, et al.
Published: (2025)

Do LLMs Build World Models From Text? A Multilingual Diagnostic of Spatial Reasoning
by: Pan, Zhikai, et al.
Published: (2026)

Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models
by: Liu, Ruikang, et al.
Published: (2025)

Evolutionary System 2 Reasoning: An Empirical Proof
by: Ma, Zeyuan, et al.
Published: (2025)

Reason Analogically via Cross-domain Prior Knowledge: An Empirical Study of Cross-domain Knowledge Transfer for In-Context Learning
by: Liu, Le, et al.
Published: (2026)

Safety Through Reasoning: An Empirical Study of Reasoning Guardrail Models
by: Sreedhar, Makesh Narsimhan, et al.
Published: (2025)

On the Empirical Complexity of Reasoning and Planning in LLMs
by: Kang, Liwei, et al.
Published: (2024)

Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
by: Zhuang, Xialie, et al.
Published: (2025)

Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMs
by: Su, Jinyan, et al.
Published: (2025)

Strategy-Aware Optimization Modeling with Reasoning LLMs
by: Zhao, Ruiqing, et al.
Published: (2026)

Reasoning as an Attack Surface: Adaptive Evolutionary CoT Jailbreaks for LLMs
by: Li, Jianan, et al.
Published: (2026)

InfiR : Crafting Effective Small Language Models and Multimodal Small Language Models in Reasoning
by: Xie, Congkai, et al.
Published: (2025)

An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning
by: Chen, Zui, et al.
Published: (2024)

Reinforcement Learning for Out-of-Distribution Reasoning in LLMs: An Empirical Study on Diagnosis-Related Group Coding
by: Wang, Hanyin, et al.
Published: (2025)

Effective Reinforcement Learning for Reasoning in Language Models
by: Huang, Lianghuan, et al.
Published: (2025)

Reasoning Language Model Inference Serving Unveiled: An Empirical Study
by: Li, Qi, et al.
Published: (2025)

Can Slow-thinking LLMs Reason Over Time? Empirical Studies in Time Series Forecasting
by: Cheng, Mingyue, et al.
Published: (2025)

Small Models Struggle to Learn from Strong Reasoners
by: Li, Yuetai, et al.
Published: (2025)

Distilling Mathematical Reasoning Capabilities into Small Language Models
by: Zhu, Xunyu, et al.
Published: (2024)

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis
by: Zhao, Yufeng, et al.
Published: (2025)

How Well Do LLMs Perform on the Simplest Long-Chain Reasoning Tasks: An Empirical Study on the Equivalence Class Problem
by: Zheng, Chun, et al.
Published: (2026)

MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMs
by: Zhao, Guojiang, et al.
Published: (2025)

Towards Reasoning Ability of Small Language Models
by: Srivastava, Gaurav, et al.
Published: (2025)

Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Models
by: Kasat, Aryan, et al.
Published: (2026)

Benchmarking Small Language Models and Small Reasoning Language Models on System Log Severity Classification
by: Masri, Yahya, et al.
Published: (2026)

Stepwise Reasoning Error Disruption Attack of LLMs
by: Peng, Jingyu, et al.
Published: (2024)

SATURN: SAT-based Reinforcement Learning to Unleash LLMs Reasoning
by: Liu, Huanyu, et al.
Published: (2025)

Incentivizing Consistent, Effective and Scalable Reasoning Capability in Audio LLMs via Reasoning Process Rewards
by: Fan, Jiajun, et al.
Published: (2025)

Enhancing Reasoning Abilities of Small LLMs with Cognitive Alignment
by: Cai, Wenrui, et al.
Published: (2025)

Agentic Frameworks for Reasoning Tasks: An Empirical Study
by: Rasheed, Zeeshan, et al.
Published: (2026)

An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint
by: Sun, Yi, et al.
Published: (2025)

Reasoning Models Can Be Effective Without Thinking
by: Ma, Wenjie, et al.
Published: (2025)

LocationReasoner: Evaluating LLMs on Real-World Site Selection Reasoning
by: Koda, Miho, et al.
Published: (2025)

TrigReason: Trigger-Based Collaboration between Small and Large Reasoning Models
by: Zhao, Yi, et al.
Published: (2026)

Open the Oyster: Empirical Evaluation and Improvement of Code Reasoning Confidence in LLMs
by: Wang, Shufan, et al.
Published: (2025)

Task Complexity Matters: An Empirical Study of Reasoning in LLMs for Sentiment Analysis
by: Huang, Donghao, et al.
Published: (2026)

Demystifying the Roles of LLM Layers in Retrieval, Knowledge, and Reasoning
by: Song, Xinyuan, et al.
Published: (2025)

ReasonAny: Incorporating Reasoning Capability to Any Model via Simple and Effective Model Merging
by: Yang, Junyao, et al.
Published: (2026)