Imagen de Portada

Dynamic Model Merging Made Slim

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Du, Guodong, Lin, Wanyu
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Model Merging for Knowledge Editing
por: Fu, Zichuan, et al.
Publicado: (2025)

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
por: Lu, Zhenyi, et al.
Publicado: (2024)

Training-free LLM Merging for Multi-task Learning
por: Fu, Zichuan, et al.
Publicado: (2025)

Knowledge Fusion of Large Language Models Via Modular SkillPacks
por: Du, Guodong, et al.
Publicado: (2025)

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
por: Tang, Shengkun, et al.
Publicado: (2026)

Parameter Competition Balancing for Model Merging
por: Du, Guodong, et al.
Publicado: (2024)

Merge to Mix: Mixing Datasets via Model Merging
por: Tao, Zhixu Silvia, et al.
Publicado: (2025)

The Compositional Architecture of Regret in Large Language Models
por: Cui, Xiangxiang, et al.
Publicado: (2025)

Towards Improved Preference Optimization Pipeline: from Data Generation to Budget-Controlled Regularization
por: Chen, Zhuotong, et al.
Publicado: (2024)

Arcee's MergeKit: A Toolkit for Merging Large Language Models
por: Goddard, Charles, et al.
Publicado: (2024)

MrT5: Dynamic Token Merging for Efficient Byte-level Language Models
por: Kallini, Julie, et al.
Publicado: (2024)

K-Merge: Online Continual Merging of Adapters for On-device Large Language Models
por: Shenaj, Donald, et al.
Publicado: (2025)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
por: Yang, Jinluan, et al.
Publicado: (2025)

What Matters for Model Merging at Scale?
por: Yadav, Prateek, et al.
Publicado: (2024)

Channel Merging: Preserving Specialization for Merged Experts
por: Zhang, Mingyang, et al.
Publicado: (2024)

STAR: Spectral Truncation and Rescale for Model Merging
por: Lee, Yu-Ang, et al.
Publicado: (2025)

Fisher Mask Nodes for Language Model Merging
por: K, Thennal D, et al.
Publicado: (2024)

Model Merging by Uncertainty-Based Gradient Matching
por: Daheim, Nico, et al.
Publicado: (2023)

Optimal Brain Iterative Merging: Mitigating Interference in LLM Merging
por: Wang, Zhixiang, et al.
Publicado: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)

Model Assembly Learning with Heterogeneous Layer Weight Merging
por: Zhang, Yi-Kai, et al.
Publicado: (2025)

Merging Text Transformer Models from Different Initializations
por: Verma, Neha, et al.
Publicado: (2024)

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch
por: Hammoud, Hasan Abed Al Kader, et al.
Publicado: (2024)

Merge-of-Thought Distillation
por: Shen, Zhanming, et al.
Publicado: (2025)

DAM: Dynamic Adapter Merging for Continual Video QA Learning
por: Cheng, Feng, et al.
Publicado: (2024)

Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation
por: Gauthier-Caron, Thomas, et al.
Publicado: (2024)

One Size Does Not Fit All: A Distribution-Aware Sparsification for More Precise Model Merging
por: Luo, Yingfeng, et al.
Publicado: (2025)

Data-driven Clustering and Merging of Adapters for On-device Large Language Models
por: Bohdal, Ondrej, et al.
Publicado: (2026)

Unraveling LoRA Interference: Orthogonal Subspaces for Robust Model Merging
por: Zhang, Haobo, et al.
Publicado: (2025)

Branch-Solve-Merge Improves Large Language Model Evaluation and Generation
por: Saha, Swarnadeep, et al.
Publicado: (2023)

FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"
por: Ming, Yifei, et al.
Publicado: (2024)

Slim-SC: Thought Pruning for Efficient Scaling with Self-Consistency
por: Hong, Colin, et al.
Publicado: (2025)

Linear Model Merging Unlocks Simple and Scalable Multimodal Data Mixture Optimization
por: Berasi, Davide, et al.
Publicado: (2026)

CLEAR: Error Analysis via LLM-as-a-Judge Made Easy
por: Yehudai, Asaf, et al.
Publicado: (2025)

Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
por: Li, Pingzhi, et al.
Publicado: (2023)

Hard Prompts Made Interpretable: Sparse Entropy Regularization for Prompt Tuning with RL
por: Choi, Yunseon, et al.
Publicado: (2024)

Navigating the Alignment-Calibration Trade-off: A Pareto-Superior Frontier via Model Merging
por: Hu, Tiancheng, et al.
Publicado: (2025)

Bone Soups: A Seek-and-Soup Model Merging Approach for Controllable Multi-Objective Generation
por: Xie, Guofu, et al.
Publicado: (2025)

Dual-Personalizing Adapter for Federated Foundation Models
por: Yang, Yiyuan, et al.
Publicado: (2024)

CPE-Identifier: Automated CPE identification and CVE summaries annotation with Deep Learning and NLP
por: Hu, Wanyu, et al.
Publicado: (2024)