Cover Image

Knowledge Fusion of Large Language Models Via Modular SkillPacks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Du, Guodong, Li, Zhuo, Zhou, Xuanning, Li, Junlin, Shi, Zesheng, Lin, Wanyu, Tang, Ho-Kin, Li, Xiucheng, Liu, Fangming, Wang, Wenya, Zhang, Min, Li, Jing
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Skill Weaving: Efficient LLM Improvement via Modular Skillpacks
by: Li, Zhuo, et al.
Published: (2026)

Multi-objective Large Language Model Alignment with Hierarchical Experts
by: Li, Zhuo, et al.
Published: (2025)

Multi-Modality Expansion and Retention for LLMs through Parameter Merging and Decoupling
by: Li, Junlin, et al.
Published: (2025)

Jailbreak-R1: Exploring the Jailbreak Capabilities of LLMs via Reinforcement Learning
by: Guo, Weiyang, et al.
Published: (2025)

Knowledge Fusion By Evolving Weights of Language Models
by: Du, Guodong, et al.
Published: (2024)

Adaptive Detoxification: Safeguarding General Capabilities of LLMs through Toxicity-Aware Knowledge Editing
by: Lu, Yifan, et al.
Published: (2025)

Vocabulary Hijacking in LVLMs: Unveiling Critical Attention Heads by Excluding Inert Tokens to Mitigate Hallucination
by: Chen, Yangneng, et al.
Published: (2026)

Safety Alignment via Constrained Knowledge Unlearning
by: Shi, Zesheng, et al.
Published: (2025)

Dynamic Model Merging Made Slim
by: Du, Guodong, et al.
Published: (2026)

D-QRELO: Training- and Data-Free Delta Compression for Large Language Models via Quantization and Residual Low-Rank Approximation
by: Li, Junlin, et al.
Published: (2026)

Echoes as Anchors: Probabilistic Costs and Attention Refocusing in LLM Reasoning
by: Hao, Zhuoyuan, et al.
Published: (2026)

Multimodal Reasoning with Multimodal Knowledge Graph
by: Lee, Junlin, et al.
Published: (2024)

Parameter Competition Balancing for Model Merging
by: Du, Guodong, et al.
Published: (2024)

Transitivity Meets Cyclicity: Explicit Preference Decomposition for Dynamic Large Language Model Alignment
by: Huang, Yucong, et al.
Published: (2026)

Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer
by: Du, Guodong, et al.
Published: (2025)

Designing Robust Single Atom Catalysts by Three‐in‐One Strategy: Sub‐1‐nm Space Confining, Bimetallic Bonding and Reaction‐Induced Forming Active Sites
by: Zesheng Li
Published: (2024)

Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
by: Li, Wu, et al.
Published: (2026)

A Brief Overview: On-Policy Self-Distillation In Large Language Models
by: Cui, Fangming, et al.
Published: (2026)

AFter: Attention-based Fusion Router for RGBT Tracking
by: Lu, Andong, et al.
Published: (2024)

Impacts of Darwinian Evolution on Pre-trained Deep Neural Networks
by: Du, Guodong, et al.
Published: (2024)

RGBT Tracking via All-layer Multimodal Interactions with Progressive Fusion Mamba
by: Lu, Andong, et al.
Published: (2024)

Modular Blind Video Quality Assessment
by: Wen, Wen, et al.
Published: (2024)

Knowledge Editing with Dynamic Knowledge Graphs for Multi-Hop Question Answering
by: Lu, Yifan, et al.
Published: (2024)

Modality-Decoupled Online Recursive Editing
by: Li, Siyuan, et al.
Published: (2026)

Backdoors in RLVR: Jailbreak Backdoors in LLMs From Verifiable Reward
by: Guo, Weiyang, et al.
Published: (2026)

Visual-RAG: Benchmarking Text-to-Image Retrieval Augmented Generation for Visual Knowledge Intensive Queries
by: Wu, Yin, et al.
Published: (2025)

STARE at the Structure: Steering ICL Exemplar Selection with Structural Alignment
by: Li, Jiaqian, et al.
Published: (2025)

Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering
by: Zhang, Yichi, et al.
Published: (2023)

Evolutionary Neural Architecture Search for 3D Point Cloud Analysis
by: Yang, Yisheng, et al.
Published: (2024)

Modular Stereodivergent Chemoenzymatic Total Synthesis of (+)‐ and (‐)‐ Glabridin
by: Xuan Wang, et al.
Published: (2026)

Survive the economic downturn: Operating flexibility, productivity, and stock crash
by: Yang Li, et al.
Published: (2024)

Federated Vision-Language-Recommendation with Personalized Fusion
by: Li, Zhiwei, et al.
Published: (2024)

Breaking Shallow Limits: Task-Driven Pixel Fusion for Gap-free RGBT Tracking
by: Lu, Andong, et al.
Published: (2025)

Exploring the Translation Mechanism of Large Language Models
by: Zhang, Hongbin, et al.
Published: (2025)

Dynamic Catalytic Structures of Single‐Atom (or Cluster) Catalysts: A Perspective Review
by: Zesheng Li, et al.
Published: (2025)

A Collaborative Framework Integrating Large Language Model and Chemical Fragment Space: Mutual Inspiration for Lead Design
by: Tuo, Hao, et al.
Published: (2025)

Pack-PTQ: Advancing Post-training Quantization of Neural Networks by Pack-wise Reconstruction
by: Li, Changjun, et al.
Published: (2025)

Knowledge Boundary of Large Language Models: A Survey
by: Li, Moxin, et al.
Published: (2024)

Rethinking Agentic Reinforcement Learning In Large Language Models
by: Cui, Fangming, et al.
Published: (2026)

CADE: Cosine Annealing Differential Evolution for Spiking Neural Network
by: Jiang, Runhua, et al.
Published: (2024)