Imagen de Portada

Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Yue, Yuanhao, Wang, Chengyu, Huang, Jun, Wang, Peng
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models
por: Wang, Chengyu, et al.
Publicado: (2025)

EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models
por: Wang, Chengyu, et al.
Publicado: (2025)

Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud
por: Yue, Yuanhao, et al.
Publicado: (2024)

OmniThoughtVis: A Scalable Distillation Pipeline for Deployable Multimodal Reasoning Models
por: Yue, Yuanhao, et al.
Publicado: (2026)

From Correction to Mastery: Reinforced Distillation of Large Language Model Agents
por: Lyu, Yuanjie, et al.
Publicado: (2025)

AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Use
por: Lyu, Yuanjie, et al.
Publicado: (2026)

Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrations
por: Ranaldi, Leonardo, et al.
Publicado: (2023)

Eliciting Causal Abilities in Large Language Models for Reasoning Tasks
por: Wang, Yajing, et al.
Publicado: (2024)

WarriorMath: Enhancing the Mathematical Ability of Large Language Models with a Defect-aware Framework
por: Chen, Yue, et al.
Publicado: (2025)

Constraint-aware Path Planning from Natural Language Instructions Using Large Language Models
por: Shim, Dylan, et al.
Publicado: (2026)

DELIA: Diversity-Enhanced Learning for Instruction Adaptation in Large Language Models
por: Zeng, Yuanhao, et al.
Publicado: (2024)

Do Large Language Models Understand Logic or Just Mimick Context?
por: Yan, Junbing, et al.
Publicado: (2024)

Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series
por: Cai, Wenrui, et al.
Publicado: (2025)

Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructions
por: Li, Jiahuan, et al.
Publicado: (2023)

Mock Worlds, Real Skills: Building Small Agentic Language Models with Synthetic Tasks, Simulated Environments, and Rubric-Based Rewards
por: Lyu, Yuanjie, et al.
Publicado: (2026)

Conifer: Improving Complex Constrained Instruction-Following Ability of Large Language Models
por: Sun, Haoran, et al.
Publicado: (2024)

Enhancing Reasoning Abilities of Small LLMs with Cognitive Alignment
por: Cai, Wenrui, et al.
Publicado: (2025)

Distilling Reasoning Ability from Large Language Models with Adaptive Thinking
por: Chen, Xiaoshu, et al.
Publicado: (2024)

InFoBench: Evaluating Instruction Following Ability in Large Language Models
por: Qin, Yiwei, et al.
Publicado: (2024)

The SIFo Benchmark: Investigating the Sequential Instruction Following Ability of Large Language Models
por: Chen, Xinyi, et al.
Publicado: (2024)

Evaluation of Instruction-Following Ability for Large Language Models on Story-Ending Generation
por: Hida, Rem, et al.
Publicado: (2024)

Large Language Models Explore by Latent Distilling
por: Zeng, Yuanhao, et al.
Publicado: (2026)

DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language Models
por: Zhang, Taolin, et al.
Publicado: (2024)

Disentangling Memory and Reasoning Ability in Large Language Models
por: Jin, Mingyu, et al.
Publicado: (2024)

InsTALL: Context-aware Instructional Task Assistance with Multi-modal Large Language Models
por: Nguyen, Pha, et al.
Publicado: (2025)

Decomposing the Basic Abilities of Large Language Models: Mitigating Cross-Task Interference in Multi-Task Instruct-Tuning
por: Wang, Bing, et al.
Publicado: (2026)

Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
por: Gu, Jia-Chen, et al.
Publicado: (2024)

Psychological Counseling Ability of Large Language Models
por: Peng, Fangyu, et al.
Publicado: (2025)

R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models
por: Zhang, Taolin, et al.
Publicado: (2024)

Extracting and Combining Abilities For Building Multi-lingual Ability-enhanced Large Language Models
por: Chen, Zhipeng, et al.
Publicado: (2024)

LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models
por: Agashe, Saaket, et al.
Publicado: (2023)

Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability
por: Sakai, Yusuke, et al.
Publicado: (2025)

KITE: A Benchmark for Evaluating Korean Instruction-Following Abilities in Large Language Models
por: Kim, Dongjun, et al.
Publicado: (2025)

From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models
por: He, Qianyu, et al.
Publicado: (2024)

AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation
por: Hu, Mengkang, et al.
Publicado: (2024)

Optimizing Language Model's Reasoning Abilities with Weak Supervision
por: Tong, Yongqi, et al.
Publicado: (2024)

Token-Efficient Leverage Learning in Large Language Models
por: Zeng, Yuanhao, et al.
Publicado: (2024)

BrailleLLM: Braille Instruction Tuning with Large Language Models for Braille Domain Tasks
por: Huang, Tianyuan, et al.
Publicado: (2025)

AutoLogi: Automated Generation of Logic Puzzles for Evaluating Reasoning Abilities of Large Language Models
por: Zhu, Qin, et al.
Publicado: (2025)

D2LLM: Decomposed and Distilled Large Language Models for Semantic Search
por: Liao, Zihan, et al.
Publicado: (2024)