Cover Image

Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Xiao, Zhou, Sihang, Liang, Ke, Sun, Xiaoyu, Liu, Xinwang
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Distilling Reasoning Ability from Large Language Models with Adaptive Thinking
by: Chen, Xiaoshu, et al.
Published: (2024)

Putting on the Thinking Hats: A Survey on Chain of Thought Fine-tuning from the Perspective of Human Reasoning Mechanism
by: Chen, Xiaoshu, et al.
Published: (2025)

ImgCoT: Compressing Long Chain of Thought into Compact Visual Tokens for Efficient Reasoning of Large Language Model
by: Chen, Xiaoshu, et al.
Published: (2026)

Mixed Distillation Helps Smaller Language Model Better Reasoning
by: Li, Chenglin, et al.
Published: (2023)

Enhancing Generalization in Chain of Thought Reasoning for Smaller Models
by: Yin, Maxwell J., et al.
Published: (2025)

Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
by: Chen, Xinghao, et al.
Published: (2025)

Chunk-Distilled Language Modeling
by: Li, Yanhong, et al.
Published: (2024)

Thinking with Sound: Audio Chain-of-Thought Enables Multimodal Reasoning in Large Audio-Language Models
by: Xiong, Zhen, et al.
Published: (2025)

Smaller Language Models Are Better Instruction Evolvers
by: Hui, Tingfeng, et al.
Published: (2024)

CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoning
by: Feng, Kehua, et al.
Published: (2025)

From Thinking to Output: Chain-of-Thought and Text Generation Characteristics in Reasoning Language Models
by: Liu, Junhao, et al.
Published: (2025)

A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodal
by: Liang, Ke, et al.
Published: (2022)

Effectiveness of Chain-of-Thought in Distilling Reasoning Capability from Large Language Models
by: Do, Cong-Thanh, et al.
Published: (2025)

STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models
by: Chiang, Cheng-Han, et al.
Published: (2025)

Better, Faster: Harnessing Self-Improvement in Large Reasoning Models
by: Zhong, Qihuang, et al.
Published: (2026)

How does Chain of Thought Think? Mechanistic Interpretability of Chain-of-Thought Reasoning with Sparse Autoencoding
by: Chen, Xi, et al.
Published: (2025)

MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models
by: Chen, Justin Chih-Yao, et al.
Published: (2024)

Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning
by: Chen, Xinghao, et al.
Published: (2025)

Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step
by: Li, Liunian Harold, et al.
Published: (2023)

BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation
by: Pang, Bo, et al.
Published: (2025)

TokenSkip: Controllable Chain-of-Thought Compression in LLMs
by: Xia, Heming, et al.
Published: (2025)

Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought
by: Lee, Jooyoung, et al.
Published: (2024)

Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning
by: Dönder, Yusuf Denizay, et al.
Published: (2025)

Abstraction-of-Thought Makes Language Models Better Reasoners
by: Hong, Ruixin, et al.
Published: (2024)

Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
by: Ye, Jiacheng, et al.
Published: (2024)

Learning to Maximize Mutual Information for Chain-of-Thought Distillation
by: Chen, Xin, et al.
Published: (2024)

Beyond Chain-of-Thought, Effective Graph-of-Thought Reasoning in Language Models
by: Yao, Yao, et al.
Published: (2023)

AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Driving
by: Qian, Kangan, et al.
Published: (2025)

THINK-Bench: Evaluating Thinking Efficiency and Chain-of-Thought Quality of Large Reasoning Models
by: Li, Zhiyuan, et al.
Published: (2025)

Thinking Without Words: Efficient Latent Reasoning with Abstract Chain-of-Thought
by: Ramji, Keshav, et al.
Published: (2026)

Language Models that Think, Chat Better
by: Bhaskar, Adithya, et al.
Published: (2025)

FedCoT: Federated Chain-of-Thought Distillation for Large Language Models
by: Fan, Tao, et al.
Published: (2024)

Chain-of-Thought Compression Should Not Be Blind: V-Skip for Efficient Multimodal Reasoning via Dual-Path Anchoring
by: Zhang, Dongxu, et al.
Published: (2026)

Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation
by: Dai, Chengwei, et al.
Published: (2024)

On the Representational Capacity of Neural Language Models with Chain-of-Thought Reasoning
by: Nowak, Franz, et al.
Published: (2024)

Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Models
by: Chen, Qiguang, et al.
Published: (2025)

R1-Compress: Long Chain-of-Thought Compression via Chunk Compression and Search
by: Wang, Yibo, et al.
Published: (2025)

Chain-of-Thought Reasoning Without Prompting
by: Wang, Xuezhi, et al.
Published: (2024)

Your Models Have Thought Enough: Training Large Reasoning Models to Stop Overthinking
by: Han, Jinyi, et al.
Published: (2025)

Empowering Smaller Models: Tuning LLaMA and Gemma with Chain-of-Thought for Ukrainian Exam Tasks
by: Syromiatnikov, Mykyta, et al.
Published: (2025)