Cover Image

Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yan, Jianzhi, Liu, Le, Pan, Youcheng, Chen, Shiwei, Xiang, Yang, Tang, Buzhou
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Long to Lean: Performance-aware and Adaptive Chain-of-Thought Compression via Multi-round Refinement
by: Yan, Jianzhi, et al.
Published: (2025)

CoDA: Towards Effective Cross-domain Knowledge Transfer via CoT-guided Domain Adaptation
by: Yan, Jianzhi, et al.
Published: (2026)

Towards Effective In-context Cross-domain Knowledge Transfer via Domain-invariant-neurons-based Retrieval
by: Yan, Jianzhi, et al.
Published: (2026)

Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability
by: Zhu, Chiwei, et al.
Published: (2025)

Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation
by: Jia, Pengyue, et al.
Published: (2024)

Efficient End-to-End Visual Document Understanding with Rationale Distillation
by: Zhu, Wang, et al.
Published: (2023)

RDRec: Rationale Distillation for LLM-based Recommendation
by: Wang, Xinfeng, et al.
Published: (2024)

Reason Analogically via Cross-domain Prior Knowledge: An Empirical Study of Cross-domain Knowledge Transfer for In-Context Learning
by: Liu, Le, et al.
Published: (2026)

Structural Rationale Distillation via Reasoning Space Compression
by: Yang, Jialin, et al.
Published: (2026)

$\textit{SKIntern}$: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models
by: Liao, Huanxuan, et al.
Published: (2024)

MARE: Multi-Aspect Rationale Extractor on Unsupervised Rationale Extraction
by: Jiang, Han, et al.
Published: (2024)

Boosting LLM Translation Skills without General Ability Loss via Rationale Distillation
by: Wu, Junhong, et al.
Published: (2024)

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA
by: Chen, Teng, et al.
Published: (2026)

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning
by: Patnaik, Sohan, et al.
Published: (2025)

Rationale-Aware Answer Verification by Pairwise Self-Evaluation
by: Kawabata, Akira, et al.
Published: (2024)

Self-Explaining Hate Speech Detection with Moral Rationales
by: Vargas, Francielle, et al.
Published: (2026)

Align-GRAG: Anchor and Rationale Guided Dual Alignment for Graph Retrieval-Augmented Generation
by: Xu, Derong, et al.
Published: (2025)

SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales
by: Xu, Tianyang, et al.
Published: (2024)

Rationale-Guided Retrieval Augmented Generation for Medical Question Answering
by: Sohn, Jiwoong, et al.
Published: (2024)

RORA: Robust Free-Text Rationale Evaluation
by: Jiang, Zhengping, et al.
Published: (2024)

Rationale-based Opinion Summarization
by: Li, Haoyuan, et al.
Published: (2024)

Towards Rationale-Answer Alignment of LVLMs via Self-Rationale Calibration
by: Wu, Yuanchen, et al.
Published: (2025)

QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models
by: Wang, Wei, et al.
Published: (2024)

Verbosity-Aware Rationale Reduction: Effective Reduction of Redundant Rationale via Principled Criteria
by: Jang, Joonwon, et al.
Published: (2024)

Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation
by: Nath, Abhijnan, et al.
Published: (2024)

Stealth Fine-Tuning: Efficiently Breaking Alignment in RVLMs Using Self-Generated CoT
by: Yu, Le, et al.
Published: (2025)

How Ambiguous Are the Rationales for Natural Language Reasoning? A Simple Approach to Handling Rationale Uncertainty
by: Kim, Hazel H.
Published: (2024)

AS-ES Learning: Towards Efficient CoT Learning in Small Models
by: Xi, Nuwa, et al.
Published: (2024)

Capturing Visualization Design Rationale
by: Hutchinson, Maeve, et al.
Published: (2025)

Investigating Mysteries of CoT-Augmented Distillation
by: Wadhwa, Somin, et al.
Published: (2024)

Rationale Behind Essay Scores: Enhancing S-LLM's Multi-Trait Essay Scoring with Rationale Generated by LLMs
by: Chu, SeongYeub, et al.
Published: (2024)

InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales
by: Wei, Zhepei, et al.
Published: (2024)

Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning
by: Yan, Shaotian, et al.
Published: (2026)

Rationale-guided Prompting for Knowledge-based Visual Question Answering
by: Hu, Zhongjian, et al.
Published: (2024)

AlpaGasus: Training A Better Alpaca with Fewer Data
by: Chen, Lichang, et al.
Published: (2023)

Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation
by: Song, Hoyun, et al.
Published: (2025)

Are Rationales Necessary and Sufficient? Tuning LLMs for Explainable Misinformation Detection
by: Wang, Bing, et al.
Published: (2026)

Investigating the Impact of Rationales for LLMs on Natural Language Understanding
by: Shi, Wenhang, et al.
Published: (2025)

Aligning Attention with Human Rationales for Self-Explaining Hate Speech Detection
by: Eilertsen, Brage, et al.
Published: (2025)

Rethinking Human Preference Evaluation of LLM Rationales
by: Li, Ziang, et al.
Published: (2025)