Cover Image

XPERT: Expert Knowledge Transfer for Effective Training of Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Chang, Shi, Boyu, Yang, Xu, Geng, Xin
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Chain-based Distillation for Effective Initialization of Variable-Sized Small Language Models
by: Shi, Boyu, et al.
Published: (2026)

Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
by: Shi, Boyu, et al.
Published: (2026)

Every Expert Matters: Towards Effective Knowledge Distillation for Mixture-of-Experts Language Models
by: Kim, Gyeongman, et al.
Published: (2025)

ExpertPrompting: Instructing Large Language Models to be Distinguished Experts
by: Xu, Benfeng, et al.
Published: (2023)

Progressively Label Enhancement for Large Language Model Alignment
by: Liu, Biao, et al.
Published: (2024)

Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Models
by: Liu, Biao, et al.
Published: (2025)

Functional Abstraction of Knowledge Recall in Large Language Models
by: Wang, Zijian, et al.
Published: (2025)

MLAN: Language-Based Instruction Tuning Preserves and Transfers Knowledge in Multimodal Language Models
by: Tu, Jianhong, et al.
Published: (2024)

Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models
by: Yang, Junjie, et al.
Published: (2025)

From Beginner to Expert: Modeling Medical Knowledge into General LLMs
by: Li, Qiang, et al.
Published: (2023)

Tracing the Roots of Facts in Multilingual Language Models: Independent, Shared, and Transferred Knowledge
by: Zhao, Xin, et al.
Published: (2024)

Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Models
by: Jia, Boyu, et al.
Published: (2025)

Contrastive Knowledge Transfer and Robust Optimization for Secure Alignment of Large Language Models
by: Zheng, Jiasen, et al.
Published: (2025)

VRM: Teaching Reward Models to Understand Authentic Human Preferences
by: Liu, Biao, et al.
Published: (2026)

Exploring and Enhancing the Transfer of Distribution in Knowledge Distillation for Autoregressive Language Models
by: Rao, Jun, et al.
Published: (2024)

Training-Free Dynamic Upcycling of Expert Language Models
by: Fanì, Eros, et al.
Published: (2026)

Are Large Language Models Effective Knowledge Graph Constructors?
by: Chen, Ruirui, et al.
Published: (2025)

Financial Knowledge Large Language Model
by: Yang, Cehao, et al.
Published: (2024)

Negative-Prompt-driven Alignment for Generative Language Model
by: Qiao, Shiqi, et al.
Published: (2024)

Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Base
by: Song, Linxin, et al.
Published: (2025)

How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models
by: Lee, Jaeyoung, et al.
Published: (2024)

Scale-Distribution Decoupling: Enabling Stable and Effective Training of Large Language Models
by: Wang, Ya, et al.
Published: (2025)

SEAP: Training-free Sparse Expert Activation Pruning Unlock the Brainpower of Large Language Models
by: Liang, Xun, et al.
Published: (2025)

Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models
by: Pan, Bowen, et al.
Published: (2024)

Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts
by: Zhang, Zeliang, et al.
Published: (2024)

Language Model Can Do Knowledge Tracing: Simple but Effective Method to Integrate Language Model and Knowledge Tracing Task
by: Lee, Unggi, et al.
Published: (2024)

Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?
by: Sun, Kai, et al.
Published: (2023)

Automating Expert-Level Medical Reasoning Evaluation of Large Language Models
by: Zhou, Shuang, et al.
Published: (2025)

Paths-over-Graph: Knowledge Graph Empowered Large Language Model Reasoning
by: Tan, Xingyu, et al.
Published: (2024)

On the Effectiveness of Incremental Training of Large Language Models
by: Li, Miles Q., et al.
Published: (2024)

Routing Distilled Knowledge via Mixture of LoRA Experts for Large Language Model based Bundle Generation
by: Feng, Kaidong, et al.
Published: (2025)

Scalable Training of Mixture-of-Experts Models with Megatron Core
by: Yan, Zijie, et al.
Published: (2026)

Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models
by: Belenki, Lior, et al.
Published: (2025)

MiniPLM: Knowledge Distillation for Pre-Training Language Models
by: Gu, Yuxian, et al.
Published: (2024)

Are Expert-Level Language Models Expert-Level Annotators?
by: Tseng, Yu-Min, et al.
Published: (2024)

Flexible and Effective Mixing of Large Language Models into a Mixture of Domain Experts
by: Lee, Rhui Dih, et al.
Published: (2024)

Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model
by: Geng, Yuxia, et al.
Published: (2023)

Large Language Models for Knowledge Graph Embedding: A Survey
by: Liu, Bingchen, et al.
Published: (2025)

Timber: Training-free Instruct Model Refining with Base via Effective Rank
by: Wu, Taiqiang, et al.
Published: (2025)

Hybrid Alignment Training for Large Language Models
by: Wang, Chenglong, et al.
Published: (2024)