Cover Image

Keypoint-based Progressive Chain-of-Thought Distillation for LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Feng, Kaituo, Li, Changsheng, Zhang, Xiaolu, Zhou, Jun, Yuan, Ye, Wang, Guoren
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning to Generate Parameters of ConvNets for Unseen Image Data
by: Wang, Shiye, et al.
Published: (2023)

On the Road to Portability: Compressing End-to-End Motion Planner for Autonomous Driving
by: Feng, Kaituo, et al.
Published: (2024)

Slow Tuning and Low-Entropy Masking for Safe Chain-of-Thought Distillation
by: Ma, Ziyang, et al.
Published: (2025)

Autonomous Chain-of-Thought Distillation for Graph-Based Fraud Detection
by: Li, Yuan, et al.
Published: (2026)

CoT-Evo: Evolutionary Distillation of Chain-of-Thought for Scientific Reasoning
by: Feng, Kehua, et al.
Published: (2025)

Efficient Reasoning for LLMs through Speculative Chain-of-Thought
by: Wang, Jikai, et al.
Published: (2025)

Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning
by: Chen, Xinghao, et al.
Published: (2025)

BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation
by: Pang, Bo, et al.
Published: (2025)

Direct Value Optimization: Improving Chain-of-Thought Reasoning in LLMs with Refined Values
by: Zhang, Hongbo, et al.
Published: (2025)

LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thought
by: Jiang, Zhuoxuan, et al.
Published: (2024)

Graph-Based Chain-of-Thought Pruning for Reducing Redundant Reflections in Reasoning LLMs
by: Yuan, Hongyuan, et al.
Published: (2026)

TokenSkip: Controllable Chain-of-Thought Compression in LLMs
by: Xia, Heming, et al.
Published: (2025)

Instance-adaptive Zero-shot Chain-of-Thought Prompting
by: Yuan, Xiaosong, et al.
Published: (2024)

Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
by: Chen, Xi, et al.
Published: (2024)

Learning to Maximize Mutual Information for Chain-of-Thought Distillation
by: Chen, Xin, et al.
Published: (2024)

Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs
by: Xia, Yu, et al.
Published: (2024)

Resource-Limited Joint Multimodal Sentiment Reasoning and Classification via Chain-of-Thought Enhancement and Distillation
by: Shangguan, Haonan, et al.
Published: (2025)

CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillation
by: Shen, Zhenyi, et al.
Published: (2025)

When More is Less: Understanding Chain-of-Thought Length in LLMs
by: Wu, Yuyang, et al.
Published: (2025)

Recall with Reasoning: Chain-of-Thought Distillation for Mamba's Long-Context Memory and Extrapolation
by: Ma, Junyu, et al.
Published: (2025)

Chain-of-Thought Reasoning Without Prompting
by: Wang, Xuezhi, et al.
Published: (2024)

Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs
by: Zhang, Xuan, et al.
Published: (2024)

Robust Knowledge Adaptation for Dynamic Graph Neural Networks
by: Li, Hanjie, et al.
Published: (2022)

Scheherazade: Evaluating Chain-of-Thought Math Reasoning in LLMs with Chain-of-Problems
by: Miner, Stephen, et al.
Published: (2024)

SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoning
by: Xin, Yue, et al.
Published: (2025)

Beyond Imitation: Learning Key Reasoning Steps from Dual Chain-of-Thoughts in Reasoning Distillation
by: Dai, Chengwei, et al.
Published: (2024)

GCoT: Chain-of-Thought Prompt Learning for Graphs
by: Yu, Xingtong, et al.
Published: (2025)

Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs
by: Cao, Jie, et al.
Published: (2026)

Student-in-the-Loop Chain-of-Thought Distillation via Generation-Time Selection
by: He, Chaoqun, et al.
Published: (2026)

Knowledge Distillation with Structured Chain-of-Thought for Text-to-SQL
by: Thaker, Khushboo, et al.
Published: (2025)

Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step
by: Li, Liunian Harold, et al.
Published: (2023)

S3-CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMs
by: Du, Yanrui, et al.
Published: (2026)

Demystifying Long Chain-of-Thought Reasoning in LLMs
by: Yeo, Edward, et al.
Published: (2025)

DICE: Structured Reasoning in LLMs through SLM-Guided Chain-of-Thought Correction
by: Li, Yiqi, et al.
Published: (2025)

Reinforcing the Diffusion Chain of Lateral Thought with Diffusion Language Models
by: Huang, Zemin, et al.
Published: (2025)

Eliciting Chain-of-Thought in Base LLMs via Gradient-Based Representation Optimization
by: Wang, Zijian, et al.
Published: (2025)

Mitigating Spurious Correlations Between Question and Answer via Chain-of-Thought Correctness Perception Distillation
by: Xie, Hongyan, et al.
Published: (2025)

Upfront Chain-of-Thought: A Cooperative Framework for Chain-of-Thought Compression
by: Li, Chengzhengxu, et al.
Published: (2025)

Effectiveness of Chain-of-Thought in Distilling Reasoning Capability from Large Language Models
by: Do, Cong-Thanh, et al.
Published: (2025)

Evaluating GRPO and DPO for Faithful Chain-of-Thought Reasoning in LLMs
by: Mohammadi, Hadi, et al.
Published: (2025)