Image de couverture de livre

Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liao, Huanxuan, He, Shizhu, Xu, Yao, Zhang, Yuanzhe, Liu, Kang, Zhao, Jun
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

$\textit{SKIntern}$: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models
par: Liao, Huanxuan, et autres
Publié: (2024)

Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering
par: Liao, Huanxuan, et autres
Publié: (2024)

From Instance Training to Instruction Learning: Task Adapters Generation from Instructions
par: Liao, Huanxuan, et autres
Publié: (2024)

DATA: Decomposed Attention-based Task Adaptation for Rehearsal-Free Continual Learning
par: Liao, Huanxuan, et autres
Publié: (2025)

Beyond Hard and Soft: Hybrid Context Compression for Balancing Local and Global Information Retention
par: Liao, Huanxuan, et autres
Publié: (2025)

Dynamic Parametric Retrieval Augmented Generation for Test-time Knowledge Enhancement
par: Tan, Yuqiao, et autres
Publié: (2025)

Shuttle Between the Instructions and the Parameters of Large Language Models
par: Sun, Wangtao, et autres
Publié: (2025)

Mastering Symbolic Operations: Augmenting Language Models with Compiled Neural Networks
par: Weng, Yixuan, et autres
Publié: (2023)

ResAdapt: Adaptive Resolution for Efficient Multimodal Reasoning
par: Liao, Huanxuan, et autres
Publié: (2026)

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models
par: Tan, Yuqiao, et autres
Publié: (2025)

ExpNote: Black-box Large Language Models are Better Task Solvers with Experience Notebook
par: Sun, Wangtao, et autres
Publié: (2023)

The Zero-Step Thinking: An Empirical Study of Mode Selection as Harder Early Exit in Reasoning Models
par: Tan, Yuqiao, et autres
Publié: (2025)

ControlLM: Crafting Diverse Personalities for Language Models
par: Weng, Yixuan, et autres
Publié: (2024)

SparK: Query-Aware Unstructured Sparsity with Recoverable KV Cache Channel Pruning
par: Liao, Huanxuan, et autres
Publié: (2025)

SC-Taxo: Hierarchical Taxonomy Generation under Semantic Consistency Constraints using Large Language Models
par: Cai, Shiqiang, et autres
Publié: (2026)

CITI: Enhancing Tool Utilizing Ability in Large Language Models without Sacrificing General Performance
par: Hao, Yupu, et autres
Publié: (2024)

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models
par: Lei, Fangyu, et autres
Publié: (2023)

Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model
par: Xia, Fei, et autres
Publié: (2024)

Reasoning-Table: Exploring Reinforcement Learning for Table Reasoning
par: Lei, Fangyu, et autres
Publié: (2025)

BP4ER: Bootstrap Prompting for Explicit Reasoning in Medical Dialogue Generation
par: He, Yuhong, et autres
Publié: (2024)

ItD: Large Language Models Can Teach Themselves Induction through Deduction
par: Sun, Wangtao, et autres
Publié: (2024)

Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints
par: Song, Ran, et autres
Publié: (2024)

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
par: Luo, Tongxu, et autres
Publié: (2024)

Evaluating Personalized Tool-Augmented LLMs from the Perspectives of Personalization and Proactivity
par: Hao, Yupu, et autres
Publié: (2025)

LLaSA: Large Language and Structured Data Assistant
par: Xu, Yao, et autres
Publié: (2024)

Amplify Adjacent Token Differences: Enhancing Long Chain-of-Thought Reasoning with Shift-FFN
par: Xu, Yao, et autres
Publié: (2025)

Efficient Data Learning for Open Information Extraction with Pre-trained Language Models
par: Fan, Zhiyuan, et autres
Publié: (2023)

Socratic-PRMBench: Benchmarking Process Reward Models with Systematic Reasoning Patterns
par: Li, Xiang, et autres
Publié: (2025)

Distilling Mathematical Reasoning Capabilities into Small Language Models
par: Zhu, Xunyu, et autres
Publié: (2024)

Improving Reasoning Capabilities in Small Models through Mixture-of-Layers Distillation with Stepwise Attention on Key Information
par: Chen, Yao, et autres
Publié: (2026)

SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
par: Yang, Ling, et autres
Publié: (2024)

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models
par: Sun, Wangtao, et autres
Publié: (2024)

SymbolicThought: Integrating Language Models and Symbolic Reasoning for Consistent and Interpretable Human Relationship Understanding
par: Zhao, Runcong, et autres
Publié: (2025)

Self-Enhanced Reasoning Training: Activating Latent Reasoning in Small Models for Enhanced Reasoning Distillation
par: Zhang, Yong, et autres
Publié: (2025)

An Analysis for Reasoning Bias of Language Models with Small Initialization
par: Yao, Junjie, et autres
Publié: (2025)

Large Language Model-based Human-Agent Collaboration for Complex Task Solving
par: Feng, Xueyang, et autres
Publié: (2024)

WideSeek: Advancing Wide Research via Multi-Agent Scaling
par: Huang, Ziyang, et autres
Publié: (2026)

CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph
par: Zhou, Tong, et autres
Publié: (2024)

Confidence-Calibrated Small-Large Language Model Collaboration for Cost-Efficient Reasoning
par: Zhang, Chuang, et autres
Publié: (2026)

Collaborative Distillation Strategies for Parameter-Efficient Language Model Deployment
par: Meng, Xiandong, et autres
Publié: (2025)