Copertina

Tailoring Instructions to Student's Learning Levels Boosts Knowledge Distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ren, Yuxin, Zhong, Zihan, Shi, Xingjian, Zhu, Yi, Yuan, Chun, Li, Mu
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Layer-Aware Task Arithmetic: Disentangling Task-Specific and Instruction-Following Knowledge
di: Chen, Yan-Lun, et al.
Pubblicazione: (2025)

Sinkhorn Distance Minimization for Knowledge Distillation
di: Cui, Xiao, et al.
Pubblicazione: (2024)

Brewing Knowledge in Context: Distillation Perspectives on In-Context Learning
di: Li, Chengye, et al.
Pubblicazione: (2025)

Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning
di: Li, Xiaochuan, et al.
Pubblicazione: (2024)

SEEKR: Selective Attention-Guided Knowledge Retention for Continual Learning of Large Language Models
di: He, Jinghan, et al.
Pubblicazione: (2024)

Knowledge Distillation and Dataset Distillation of Large Language Models: Emerging Trends, Challenges, and Future Directions
di: Fang, Luyang, et al.
Pubblicazione: (2025)

Reward-SQL: Boosting Text-to-SQL via Stepwise Reasoning and Process-Supervised Rewards
di: Zhang, Yuxin, et al.
Pubblicazione: (2025)

Reinforcement Learning-based Knowledge Distillation with LLM-as-a-Judge
di: Shen, Yiyang, et al.
Pubblicazione: (2026)

Knowledge Distillation with Training Wheels
di: Liu, Guanlin, et al.
Pubblicazione: (2025)

Enhancing CLIP Conceptual Embedding through Knowledge Distillation
di: Kao, Kuei-Chun
Pubblicazione: (2024)

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning
di: Lin, Zihan, et al.
Pubblicazione: (2026)

Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation
di: Jayawardena, Lasal, et al.
Pubblicazione: (2024)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
di: Xu, Hongling, et al.
Pubblicazione: (2025)

Multi-modal Anchor Gated Transformer with Knowledge Distillation for Emotion Recognition in Conversation
di: Li, Jie, et al.
Pubblicazione: (2025)

LoCa: Logit Calibration for Knowledge Distillation
di: Yang, Runming, et al.
Pubblicazione: (2024)

Confidence Preservation Property in Knowledge Distillation Abstractions
di: Vengertsev, Dmitry, et al.
Pubblicazione: (2024)

Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction
di: Yao, Hao-Ren, et al.
Pubblicazione: (2022)

Rebellious Student: Reversing Teacher Signals for Reasoning Exploration with Self-Distilled RLVR
di: Kim, Jeonghye, et al.
Pubblicazione: (2026)

Boosting Lossless Speculative Decoding via Feature Sampling and Partial Alignment Distillation
di: Gui, Lujun, et al.
Pubblicazione: (2024)

Implicit Word Reordering with Knowledge Distillation for Cross-Lingual Dependency Parsing
di: Li, Zhuoran, et al.
Pubblicazione: (2025)

In Good GRACEs: Principled Teacher Selection for Knowledge Distillation
di: Panigrahi, Abhishek, et al.
Pubblicazione: (2025)

Efficient Knowledge Injection in LLMs via Self-Distillation
di: Kujanpää, Kalle, et al.
Pubblicazione: (2024)

Enhancing LLM Tool Use with High-quality Instruction Data from Knowledge Graph
di: Wang, Jingwei, et al.
Pubblicazione: (2025)

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
di: Kim, Gyeongman, et al.
Pubblicazione: (2024)

Gender Bias in Instruction-Guided Speech Synthesis Models
di: Kuan, Chun-Yi, et al.
Pubblicazione: (2025)

RAG-Instruct: Boosting LLMs with Diverse Retrieval-Augmented Instructions
di: Liu, Wanlong, et al.
Pubblicazione: (2024)

Embracing Imperfection: Simulating Students with Diverse Cognitive Levels Using LLM-based Agents
di: Wu, Tao, et al.
Pubblicazione: (2025)

Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation
di: Xia, Mingxuan, et al.
Pubblicazione: (2025)

Language Model Knowledge Distillation for Efficient Question Answering in Spanish
di: Bazaga, Adrián, et al.
Pubblicazione: (2023)

Relational Knowledge Distillation Using Fine-tuned Function Vectors
di: Kang, Andrea, et al.
Pubblicazione: (2026)

A Survey on Symbolic Knowledge Distillation of Large Language Models
di: Acharya, Kamal, et al.
Pubblicazione: (2024)

Short Data, Long Context: Distilling Positional Knowledge in Transformers
di: Huber, Patrick, et al.
Pubblicazione: (2026)

X-Token: Projection-Guided Cross-Tokenizer Knowledge Distillation
di: Sreenivas, Sharath Turuvekere, et al.
Pubblicazione: (2026)

Instruction-tuned Language Models are Better Knowledge Learners
di: Jiang, Zhengbao, et al.
Pubblicazione: (2024)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
di: Zhou, Yongchao, et al.
Pubblicazione: (2023)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
di: Yang, Junjie, et al.
Pubblicazione: (2025)

Knowledge Distillation from Large Language Models for Household Energy Modeling
di: Takrouri, Mohannad, et al.
Pubblicazione: (2025)

Smoothing Out Hallucinations: Mitigating LLM Hallucination with Smoothed Knowledge Distillation
di: Nguyen, Hieu, et al.
Pubblicazione: (2025)

COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation
di: Zhou, Tianyi, et al.
Pubblicazione: (2026)

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
di: Zhang, Songming, et al.
Pubblicazione: (2025)