Copertina

Dual-Space Knowledge Distillation for Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Songming, Zhang, Xue, Sun, Zengkui, Chen, Yufeng, Xu, Jinan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A Dual-Space Framework for General Knowledge Distillation of Large Language Models
di: Zhang, Xue, et al.
Pubblicazione: (2025)

KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
di: Zhang, Songming, et al.
Pubblicazione: (2026)

AlignDistil: Token-Level Language Model Alignment as Adaptive Policy Distillation
di: Zhang, Songming, et al.
Pubblicazione: (2025)

Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation
di: Zhang, Songming, et al.
Pubblicazione: (2023)

LCS: A Language Converter Strategy for Zero-Shot Neural Machine Translation
di: Sun, Zengkui, et al.
Pubblicazione: (2024)

Outdated Issue Aware Decoding for Reasoning Questions on Edited Knowledge
di: Sun, Zengkui, et al.
Pubblicazione: (2024)

Cross-Lingual Knowledge Editing in Large Language Models
di: Wang, Jiaan, et al.
Pubblicazione: (2023)

Warmup-Distill: Bridge the Distribution Mismatch between Teacher and Student before Knowledge Distillation
di: Sun, Zengkui, et al.
Pubblicazione: (2025)

CM-Align: Consistency-based Multilingual Alignment for Large Language Models
di: Zhang, Xue, et al.
Pubblicazione: (2025)

Multilingual Knowledge Editing with Language-Agnostic Factual Neurons
di: Zhang, Xue, et al.
Pubblicazione: (2024)

An Empirical Study of Many-to-Many Summarization with Large Language Models
di: Wang, Jiaan, et al.
Pubblicazione: (2025)

Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation
di: He, Bowei, et al.
Pubblicazione: (2026)

Less is More: Selective Reflection for Compatible and Efficient Knowledge Distillation in Large Language Models
di: Liu, Lingyuan, et al.
Pubblicazione: (2025)

Multilingual Collaborative Defense for Large Language Models
di: Li, Hongliang, et al.
Pubblicazione: (2025)

Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application
di: Yang, Chuanpeng, et al.
Pubblicazione: (2024)

WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models
di: Ning, Kangyun, et al.
Pubblicazione: (2024)

Contextualization Distillation from Large Language Model for Knowledge Graph Completion
di: Li, Dawei, et al.
Pubblicazione: (2024)

K-ON: Stacking Knowledge On the Head Layer of Large Language Model
di: Guo, Lingbing, et al.
Pubblicazione: (2025)

Pre-training Distillation for Large Language Models: A Design Space Exploration
di: Peng, Hao, et al.
Pubblicazione: (2024)

Distilling Event Sequence Knowledge From Large Language Models
di: Wadhwa, Somin, et al.
Pubblicazione: (2024)

Cross-Modal Knowledge Distillation for Speech Large Language Models
di: Wang, Enzhi, et al.
Pubblicazione: (2025)

EasyDistill: A Comprehensive Toolkit for Effective Knowledge Distillation of Large Language Models
di: Wang, Chengyu, et al.
Pubblicazione: (2025)

Delta Knowledge Distillation for Large Language Models
di: Cao, Yihan, et al.
Pubblicazione: (2025)

ELAD: Explanation-Guided Large Language Models Active Distillation
di: Zhang, Yifei, et al.
Pubblicazione: (2024)

LLMR: Knowledge Distillation with a Large Language Model-Induced Reward
di: Li, Dongheng, et al.
Pubblicazione: (2024)

Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
di: Wu, Taiqiang, et al.
Pubblicazione: (2024)

Knowledge Distillation for Large Language Models
di: La Torre, Alejandro Paredes, et al.
Pubblicazione: (2026)

TransportationGames: Benchmarking Transportation Knowledge of (Multimodal) Large Language Models
di: Zhang, Xue, et al.
Pubblicazione: (2024)

A Survey on Large Language Models with Multilingualism: Recent Advances and New Frontiers
di: Huang, Kaiyu, et al.
Pubblicazione: (2024)

KALE: Enhancing Knowledge Manipulation in Large Language Models via Knowledge-aware Learning
di: Lv, Qitan, et al.
Pubblicazione: (2026)

Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets
di: Eiter, Thomas, et al.
Pubblicazione: (2024)

Less, but Better: Efficient Multilingual Expansion for LLMs via Layer-wise Mixture-of-Experts
di: Zhang, Xue, et al.
Pubblicazione: (2025)

Supervised Knowledge Makes Large Language Models Better In-context Learners
di: Yang, Linyi, et al.
Pubblicazione: (2023)

Chain-of-Knowledge: Integrating Knowledge Reasoning into Large Language Models by Learning from Knowledge Graphs
di: Zhang, Yifei, et al.
Pubblicazione: (2024)

The Labyrinth and the Thread: Rethinking Regularizations in Sequential Knowledge Editing for Large Language Models
di: Wang, Zheng, et al.
Pubblicazione: (2026)

Structured Agent Distillation for Large Language Model
di: Liu, Jun, et al.
Pubblicazione: (2025)

KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion
di: Wei, Yanbin, et al.
Pubblicazione: (2024)

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
di: Xu, Derong, et al.
Pubblicazione: (2024)

Being Strong Progressively! Enhancing Knowledge Distillation of Large Language Models through a Curriculum Learning Framework
di: Liu, Lingyuan, et al.
Pubblicazione: (2025)

LLM-Oriented Token-Adaptive Knowledge Distillation
di: Xie, Xurong, et al.
Pubblicazione: (2025)