Imagen de Portada

Beyond Mimicry to Contextual Guidance: Knowledge Distillation for Interactive AI

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wang, Tong, Sudhir, K.
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillation
por: Tian, Yijun, et al.
Publicado: (2024)

COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation
por: Zhou, Tianyi, et al.
Publicado: (2026)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
por: Zhang, Songming, et al.
Publicado: (2026)

Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Construction
por: Ye, Hongbin, et al.
Publicado: (2023)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
por: Zhou, Yongchao, et al.
Publicado: (2023)

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
por: Liu, Yichen, et al.
Publicado: (2022)

Delta Knowledge Distillation for Large Language Models
por: Cao, Yihan, et al.
Publicado: (2025)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
por: Yang, Runming, et al.
Publicado: (2024)

Compact Language Models via Pruning and Knowledge Distillation
por: Muralidharan, Saurav, et al.
Publicado: (2024)

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
por: Zhang, Songming, et al.
Publicado: (2025)

Beyond Architectures: Evaluating the Role of Contextual Embeddings in Detecting Bipolar Disorder on Social Media
por: Hasan, Khalid, et al.
Publicado: (2025)

AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
por: Hu, Yuezhou, et al.
Publicado: (2025)

Distilling Multi-Scale Knowledge for Event Temporal Relation Extraction
por: Yao, Hao-Ren, et al.
Publicado: (2022)

ReflectDiffu:Reflect between Emotion-intent Contagion and Mimicry for Empathetic Response Generation via a RL-Diffusion Framework
por: Yuan, Jiahao, et al.
Publicado: (2024)

DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
por: Chen, Jennifer, et al.
Publicado: (2025)

KDRL: Post-Training Reasoning LLMs via Unified Knowledge Distillation and Reinforcement Learning
por: Xu, Hongling, et al.
Publicado: (2025)

Efficient Mathematical Reasoning Models via Dynamic Pruning and Knowledge Distillation
por: Yu, Fengming, et al.
Publicado: (2025)

DOGe: Defensive Output Generation for LLM Protection Against Knowledge Distillation
por: Li, Pingzhi, et al.
Publicado: (2025)

AI Knowledge Assist: An Automated Approach for the Creation of Knowledge Bases for Conversational AI Agents
por: Laskar, Md Tahmid Rahman, et al.
Publicado: (2025)

Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation
por: Jayawardena, Lasal, et al.
Publicado: (2024)

A Dual-Space Framework for General Knowledge Distillation of Large Language Models
por: Zhang, Xue, et al.
Publicado: (2025)

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
por: Shing, Makoto, et al.
Publicado: (2025)

Leave It to the Experts: Detecting Knowledge Distillation via MoE Expert Signatures
por: Li, Pingzhi, et al.
Publicado: (2025)

Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in Product QA Agents
por: Lewis, Ashley, et al.
Publicado: (2025)

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
por: Chen, Tong, et al.
Publicado: (2024)

Few-Shot Knowledge Distillation of LLMs With Counterfactual Explanations
por: Hamman, Faisal, et al.
Publicado: (2025)

Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
por: Kim, Gyeongman, et al.
Publicado: (2025)

KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models
por: Yu, Zhuohao, et al.
Publicado: (2024)

Beyond Benchmarks: On The False Promise of AI Regulation
por: Stanovsky, Gabriel, et al.
Publicado: (2025)

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning
por: Kim, Gyeongman, et al.
Publicado: (2024)

Explain in Your Own Words: Improving Reasoning via Token-Selective Dual Knowledge Distillation
por: Kim, Minsang, et al.
Publicado: (2026)

Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents
por: Miao, Jiacheng, et al.
Publicado: (2025)

Learning to Reason under Off-Policy Guidance
por: Yan, Jianhao, et al.
Publicado: (2025)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual Settings
por: Xu, Austin, et al.
Publicado: (2025)

Ensemble Distillation for Unsupervised Constituency Parsing
por: Shayegh, Behzad, et al.
Publicado: (2023)

AWARE, Beyond Sentence Boundaries: A Contextual Transformer Framework for Identifying Cultural Capital in STEM Narratives
por: Khan, Khalid Mehtab, et al.
Publicado: (2025)

Oh! We Freeze: Improving Quantized Knowledge Distillation via Signal Propagation Analysis for Large Language Models
por: Bhardwaj, Kartikeya, et al.
Publicado: (2024)

Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework
por: Liu, Lingyuan, et al.
Publicado: (2025)

Decoupling KL and Trajectories: A Unified Perspective for SFT, DAgger, Offline RL, and OPD in LLM Distillation
por: Zhao, Anhao, et al.
Publicado: (2026)