Cover Image

HM3: Hierarchical Multi-Objective Model Merging for Pretrained Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Yu, Wu, Xingyu, Wu, Jibin, Feng, Liang, Tan, Kay Chen
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fine-Grained Model Merging via Modular Expert Recombination
by: Qiu, Haiyun, et al.
Published: (2026)

CausalBench: A Comprehensive Benchmark for Causal Learning Capability of LLMs
by: Zhou, Yu, et al.
Published: (2024)

Towards Adaptive Continual Model Merging via Manifold-Aware Expert Evolution
by: Qiu, Haiyun, et al.
Published: (2026)

LLM Cannot Discover Causality, and Should Be Restricted to Non-Decisional Support in Causal Discovery
by: Wu, Xingyu, et al.
Published: (2025)

Diversity-Aware Policy Optimization for Large Language Model Reasoning
by: Yao, Jian, et al.
Published: (2025)

Large Language Model-Enhanced Algorithm Selection: Towards Comprehensive Algorithm Representation
by: Wu, Xingyu, et al.
Published: (2023)

Design Principle Transfer in Neural Architecture Search via Large Language Models
by: Zhou, Xun, et al.
Published: (2024)

Unlock the Power of Algorithm Features: A Generalization Analysis for Algorithm Selection
by: Wu, Xingyu, et al.
Published: (2024)

Pareto Merging: Multi-Objective Optimization for Preference-Aware Model Merging
by: Chen, Weiyu, et al.
Published: (2024)

Merge and Guide: Unifying Model Merging and Guided Decoding for Controllable Multi-Objective Generation
by: Xie, Guofu, et al.
Published: (2025)

Autonomous Multi-Objective Optimization Using Large Language Model
by: Huang, Yuxiao, et al.
Published: (2024)

Toward AI Autonomous Navigation for Mechanical Thrombectomy using Hierarchical Modular Multi-agent Reinforcement Learning (HM-MARL)
by: Robertshaw, Harry, et al.
Published: (2026)

Multi-Objective Hierarchical Optimization with Large Language Models
by: Schwanke, Andrej, et al.
Published: (2026)

Vanishing Feature: Diagnosing Model Merging and Beyond
by: Qu, Xingyu, et al.
Published: (2024)

Scaling Supervised Local Learning with Augmented Auxiliary Networks
by: Ma, Chenxiang, et al.
Published: (2024)

Evolutionary Computation in the Era of Large Language Model: Survey and Roadmap
by: Wu, Xingyu, et al.
Published: (2024)

MIN-Merging: Merge the Important Neurons for Model Merging
by: Liang, Yunfei
Published: (2025)

Can Muon Fine-tune Adam-Pretrained Models?
by: Qu, Xingyu, et al.
Published: (2026)

FedMerge: Federated Personalization via Model Merging
by: Chen, Shutong, et al.
Published: (2025)

How Multimodal Integration Boost the Performance of LLM for Optimization: Case Study on Capacitated Vehicle Routing Problems
by: Huang, Yuxiao, et al.
Published: (2024)

UTICA: Multi-Objective Self-Distllation Foundation Model Pretraining for Time Series Classification
by: Moakher, Yessin, et al.
Published: (2026)

Multi-Level Collaboration in Model Merging
by: Li, Qi, et al.
Published: (2025)

GOAL: Graph-based Objective-Aligned Diffusion Solvers for Dynamic Multi-Objective Optimization
by: Li, Xingyu
Published: (2026)

Expert Merging: Model Merging with Unsupervised Expert Alignment and Importance-Guided Layer Chunking
by: Zhang, Dengming, et al.
Published: (2025)

Exploring the True Potential: Evaluating the Black-box Optimization Capability of Large Language Models
by: Huang, Beichen, et al.
Published: (2024)

Extra-Merge: Tracing the Rank-1 Subspace of Model Merging in Language Model Pre-Training
by: Zhou, Wenjie, et al.
Published: (2026)

TapWeight: Reweighting Pretraining Objectives for Task-Adaptive Pretraining
by: Zhang, Ruiyi, et al.
Published: (2024)

HMI: Hierarchical Knowledge Management for Efficient Multi-Tenant Inference in Pretrained Language Models
by: Zhang, Jun, et al.
Published: (2025)

Mitigating the Backdoor Effect for Multi-Task Model Merging via Safety-Aware Subspace
by: Yang, Jinluan, et al.
Published: (2024)

Bone Soups: A Seek-and-Soup Model Merging Approach for Controllable Multi-Objective Generation
by: Xie, Guofu, et al.
Published: (2025)

Advancing Multi-Organ Disease Care: A Hierarchical Multi-Agent Reinforcement Learning Framework
by: Tan, Daniel J., et al.
Published: (2024)

$\boldsymbol{f}$-OPD: Stabilizing Long-Horizon On-Policy Distillation with Freshness-Aware Control
by: Chen, Xianwei, et al.
Published: (2026)

PSO-Merging: Merging Models Based on Particle Swarm Optimization
by: Zhang, Kehao, et al.
Published: (2025)

Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?
by: Chen, Ruihua, et al.
Published: (2025)

$C^2M^3$: Cycle-Consistent Multi-Model Merging
by: Crisostomi, Donato, et al.
Published: (2024)

Expensive Multi-Objective Bayesian Optimization Based on Diffusion Models
by: Li, Bingdong, et al.
Published: (2024)

M-Loss: Quantifying Model Merging Compatibility with Limited Unlabeled Data
by: Wang, Tiantong, et al.
Published: (2026)

Amortized Multi-Objective Optimization Across Tasks with Generative Solution Modeling
by: Wei, Tingyang, et al.
Published: (2025)

Mix Data or Merge Models? Balancing the Helpfulness, Honesty, and Harmlessness of Large Language Model via Model Merging
by: Yang, Jinluan, et al.
Published: (2025)

MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities
by: Li, Kunxi, et al.
Published: (2024)