Cover Image

Training-free LLM Merging for Multi-task Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fu, Zichuan, Wu, Xian, Wang, Yejing, Wang, Wanyu, Ye, Shanshan, Yin, Hongzhi, Chang, Yi, Zheng, Yefeng, Zhao, Xiangyu
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Model Merging for Knowledge Editing
by: Fu, Zichuan, et al.
Published: (2025)

Sliding Window Attention Training for Efficient Large Language Models
by: Fu, Zichuan, et al.
Published: (2025)

LLMEmb: Large Language Model Can Be a Good Embedding Generator for Sequential Recommendation
by: Liu, Qidong, et al.
Published: (2024)

Attention Needs to Focus: A Unified Perspective on Attention Allocation
by: Fu, Zichuan, et al.
Published: (2026)

LLM-ESR: Large Language Models Enhancement for Long-tailed Sequential Recommendation
by: Liu, Qidong, et al.
Published: (2024)

A Multi-Expert Structural-Semantic Hybrid Framework for Unveiling Historical Patterns in Temporal Knowledge Graphs
by: Deng, Yimin, et al.
Published: (2025)

MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning
by: Deng, Yimin, et al.
Published: (2026)

AdapTime: Enabling Adaptive Temporal Reasoning in Large Language Models
by: Deng, Yimin, et al.
Published: (2026)

When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications
by: Liu, Qidong, et al.
Published: (2023)

Job Skill Extraction via LLM-Centric Multi-Module Framework
by: Li, Guojing, et al.
Published: (2026)

SEARCH-R: Structured Entity-Aware Retrieval with Chain-of-Reasoning Navigator for Multi-hop Question Answering
by: Fu, Yuqing, et al.
Published: (2026)

MTA: A Merge-then-Adapt Framework for Personalized Large Language Model
by: Li, Xiaopeng, et al.
Published: (2025)

Tandem: Riding Together with Large and Small Language Models for Efficient Reasoning
by: Fu, Zichuan, et al.
Published: (2026)

Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems
by: Liu, Langming, et al.
Published: (2025)

Reasoning Pattern Alignment Merging for Adaptive Reasoning
by: Zhong, Zhaofeng, et al.
Published: (2026)

Editing Factual Knowledge and Explanatory Ability of Medical Large Language Models
by: Xu, Derong, et al.
Published: (2024)

Functionality-Oriented LLM Merging on the Fisher--Rao Manifold
by: Wang, Jiayu, et al.
Published: (2026)

Multi-perspective Improvement of Knowledge Graph Completion with Large Language Models
by: Xu, Derong, et al.
Published: (2024)

Dynamic Model Merging Made Slim
by: Du, Guodong, et al.
Published: (2026)

MedKP: Medical Dialogue with Knowledge Enhancement and Clinical Pathway Encoding
by: Wu, Jiageng, et al.
Published: (2024)

Logic Jailbreak: Efficiently Unlocking LLM Safety Restrictions Through Formal Logical Expression
by: Peng, Jingyu, et al.
Published: (2025)

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning
by: Zhang, Hongzhi, et al.
Published: (2025)

Large Language Models for Generative Information Extraction: A Survey
by: Xu, Derong, et al.
Published: (2023)

Biomedical Entity Linking as Multiple Choice Question Answering
by: Lin, Zhenxi, et al.
Published: (2024)

Multi-task Code LLMs: Data Mix or Model Merge?
by: Zhu, Mingzhi, et al.
Published: (2026)

LLM-EDT: Large Language Model Enhanced Cross-domain Sequential Recommendation with Dual-phase Training
by: Liu, Ziwei, et al.
Published: (2025)

Training-free LLM-generated Text Detection by Mining Token Probability Sequences
by: Xu, Yihuai, et al.
Published: (2024)

Mitigating Training Imbalance in LLM Fine-Tuning via Selective Parameter Merging
by: Ju, Yiming, et al.
Published: (2024)

Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
by: Wang, Zhixiang, et al.
Published: (2025)

Sample-efficient LLM Optimization with Reset Replay
by: Liu, Zichuan, et al.
Published: (2025)

Mitigating Hallucinations of Large Language Models in Medical Information Extraction via Contrastive Decoding
by: Xu, Derong, et al.
Published: (2024)

Unconstrained Model Merging for Enhanced LLM Reasoning
by: Zhang, Yiming, et al.
Published: (2024)

FREE-Merging: Fourier Transform for Efficient Model Merging
by: Zheng, Shenghe, et al.
Published: (2024)

Mixup Model Merge: Enhancing Model Merging Performance through Randomized Linear Interpolation
by: Zhou, Yue, et al.
Published: (2025)

LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario Recommendation
by: Wang, Yuhao, et al.
Published: (2024)

Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generation
by: Zhao, Zhengyi, et al.
Published: (2026)

T$^2$: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering
by: Zhao, Zhengyi, et al.
Published: (2025)

Chinese-SkillSpan: A Span-Level Dataset for ESCO-Aligned Competency Extraction from Chinese Job Ads
by: Li, Guojing, et al.
Published: (2026)

Marco-LLM: Bridging Languages via Massive Multilingual Training for Cross-Lingual Enhancement
by: Ming, Lingfeng, et al.
Published: (2024)

MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark
by: Zhao, Qihao, et al.
Published: (2024)