Cover Image

From Task-Specific Models to Unified Systems: A Review of Model Merging Approaches

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ruan, Wei, Yang, Tianze, Zhou, Yifan, Liu, Tianming, Lu, Jin
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces
by: Marczak, Daniel, et al.
Published: (2025)

Revisiting Diffusion Models: From Generative Pre-training to One-Step Generation
by: Zheng, Bowen, et al.
Published: (2025)

ICE-SEARCH: A Language Model-Driven Feature Selection Approach
by: Yang, Tianze, et al.
Published: (2024)

AdaMerging: Adaptive Model Merging for Multi-Task Learning
by: Yang, Enneng, et al.
Published: (2023)

Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging
by: Tang, Anke, et al.
Published: (2025)

Merging without Forgetting: Continual Fusion of Task-Specific Models via Optimal Transport
by: Pan, Zecheng, et al.
Published: (2025)

Towards Unified Approaches in Self-Supervised Event Stream Modeling: Progress and Prospects
by: Zólyomi, Levente, et al.
Published: (2025)

Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent
by: Wei, Yongxian, et al.
Published: (2025)

Orthogonal Model Merging
by: Yang, Sihan, et al.
Published: (2026)

Less is More: Efficient Model Merging with Binary Task Switch
by: Qi, Biqing, et al.
Published: (2024)

Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approach
by: Jahin, Afrar, et al.
Published: (2025)

Merge and Guide: Unifying Model Merging and Guided Decoding for Controllable Multi-Objective Generation
by: Xie, Guofu, et al.
Published: (2025)

Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training
by: Zhou, Wenjie, et al.
Published: (2026)

Task Vector Quantization for Memory-Efficient Model Merging
by: Kim, Youngeun, et al.
Published: (2025)

Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks
by: Davari, MohammadReza, et al.
Published: (2023)

From Parameter to Representation: A Closed-Form Approach for Controllable Model Merging
by: Wu, Jialin, et al.
Published: (2025)

Superpose Task-specific Features for Model Merging
by: Qiu, Haiquan, et al.
Published: (2025)

Merging by Matching Models in Task Parameter Subspaces
by: Tam, Derek, et al.
Published: (2023)

FedMerge: Federated Personalization via Model Merging
by: Chen, Shutong, et al.
Published: (2025)

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
by: Lu, Zhenyi, et al.
Published: (2024)

CAT Merging: A Training-Free Approach for Resolving Conflicts in Model Merging
by: Sun, Wenju, et al.
Published: (2025)

Access Sets Matter: Budgeting Expert Reads for Scalable Weight-Space Model Merging
by: Wang, Yuanyi, et al.
Published: (2026)

Task Arithmetic in Trust Region: A Training-Free Model Merging Approach to Navigate Knowledge Conflicts
by: Sun, Wenju, et al.
Published: (2025)

MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities
by: Li, Kunxi, et al.
Published: (2024)

Representation Surgery for Multi-Task Model Merging
by: Yang, Enneng, et al.
Published: (2024)

From Function to Distribution Modeling: A PAC-Generative Approach to Offline Optimization
by: Zhang, Qiang, et al.
Published: (2024)

Whoever Started the Interference Should End It: Guiding Data-Free Model Merging via Task Vectors
by: Cheng, Runxi, et al.
Published: (2025)

Merging Language and Domain Specific Models: The Impact on Technical Vocabulary Acquisition
by: Rousset, Thibault, et al.
Published: (2025)

Task Vector Bases: A Unified and Scalable Framework for Compressed Task Arithmetic
by: Zeng, Siqi, et al.
Published: (2025)

DC-Merge: Improving Model Merging with Directional Consistency
by: Zhang, Han-Chen, et al.
Published: (2026)

Model Merging in Pre-training of Large Language Models
by: Li, Yunshui, et al.
Published: (2025)

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
by: Morrison, Jacob, et al.
Published: (2024)

Bi-level Personalization for Federated Foundation Models: A Task-vector Aggregation Approach
by: Yang, Yiyuan, et al.
Published: (2025)

A Unified Generalization Framework for Model Merging: Trade-offs, Non-Linearity, and Scaling Laws
by: Li, Qinglun, et al.
Published: (2026)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
by: Yang, Jinluan, et al.
Published: (2025)

Model Merging with Functional Dual Anchors
by: Shi, Kexuan, et al.
Published: (2025)

PSO-Merging: Merging Models Based on Particle Swarm Optimization
by: Zhang, Kehao, et al.
Published: (2025)

SoFlow: Solution Flow Models for One-Step Generative Modeling
by: Luo, Tianze, et al.
Published: (2025)

Localizing Task Information for Improved Model Merging and Compression
by: Wang, Ke, et al.
Published: (2024)

BadMerging: Backdoor Attacks Against Model Merging
by: Zhang, Jinghuai, et al.
Published: (2024)