Cover Image

Revisiting Weight Averaging for Model Merging

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Choi, Jiho, Kim, Donggyun, Lee, Chanhyuk, Hong, Seunghoon
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AdaRank: Adaptive Rank Pruning for Enhanced Model Merging
by: Lee, Chanhyuk, et al.
Published: (2025)

Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control
by: Cho, Seongwoong, et al.
Published: (2024)

HyperFlow: Gradient-Free Emulation of Few-Shot Fine-Tuning
by: Kim, Donggyun, et al.
Published: (2025)

Revisiting Random Walks for Learning on Graphs
by: Kim, Jinwoo, et al.
Published: (2024)

Sparse Weight Averaging with Multiple Particles for Iterative Magnitude Pruning
by: Choi, Moonseok, et al.
Published: (2023)

ReDi: Rectified Discrete Flow
by: Yoo, Jaehoon, et al.
Published: (2025)

Infinite Mask Diffusion for Few-Step Distillation
by: Yoo, Jaehoon, et al.
Published: (2026)

NegMerge: Sign-Consensual Weight Merging for Machine Unlearning
by: Kim, Hyo Seo, et al.
Published: (2024)

Better Not to Propagate: Understanding Edge Uncertainty and Over-smoothing in Signed Graph Neural Networks
by: Choi, Yoonhyuk, et al.
Published: (2024)

Mitigating Overfitting in Graph Neural Networks via Feature and Hyperplane Perturbation
by: Choi, Yoonhyuk, et al.
Published: (2022)

ES-Merging: Biological MLLM Merging via Embedding Space Signals
by: Lee, Wonbin, et al.
Published: (2026)

Robust Weight Initialization for Tanh Neural Networks with Fixed Point Analysis
by: Lee, Hyunwoo, et al.
Published: (2024)

Learning Probabilistic Symmetrization for Architecture Agnostic Equivariance
by: Kim, Jinwoo, et al.
Published: (2023)

Beyond Gaussian Initializations: Signal Preserving Weight Initialization for Odd-Sigmoid Activations
by: Lee, Hyunwoo, et al.
Published: (2025)

Inverting Data Transformations via Diffusion Sampling
by: Kim, Jinwoo, et al.
Published: (2026)

Weight Scope Alignment: A Frustratingly Easy Method for Model Merging
by: Xu, Yichu, et al.
Published: (2024)

AROMMA: Unifying Olfactory Embeddings for Single Molecules and Mixtures
by: Kang, Dayoung, et al.
Published: (2026)

How to Weight Multitask Finetuning? Fast Previews via Bayesian Model-Merging
by: Maldonado, Hugo Monzón, et al.
Published: (2024)

WARP: On the Benefits of Weight Averaged Rewarded Policies
by: Ramé, Alexandre, et al.
Published: (2024)

Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation
by: Gauthier-Caron, Thomas, et al.
Published: (2024)

WARM: On the Benefits of Weight Averaged Reward Models
by: Ramé, Alexandre, et al.
Published: (2024)

Progressive Weight Loading: Accelerating Initial Inference and Gradually Boosting Performance on Resource-Constrained Environments
by: Kim, Hyunwoo, et al.
Published: (2025)

MIN-Merging: Merge the Important Neurons for Model Merging
by: Liang, Yunfei
Published: (2025)

Model Assembly Learning with Heterogeneous Layer Weight Merging
by: Zhang, Yi-Kai, et al.
Published: (2025)

Multi-Hyperbolic Space-based Heterogeneous Graph Attention Network
by: Park, Jongmin, et al.
Published: (2024)

Universal Few-Shot Spatial Control for Diffusion Models
by: Nguyen, Kiet T., et al.
Published: (2025)

FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
by: Chen, Hao Mark, et al.
Published: (2025)

PSO-Merging: Merging Models Based on Particle Swarm Optimization
by: Zhang, Kehao, et al.
Published: (2025)

Bayesian Model Merging
by: Li, Kaiyang, et al.
Published: (2026)

Merge and Bound: Direct Manipulations on Weights for Class Incremental Learning
by: Kim, Taehoon, et al.
Published: (2025)

DreamCatalyst: Fast and High-Quality 3D Editing via Controlling Editability and Identity Preservation
by: Kim, Jiwook, et al.
Published: (2024)

OLR-WA: Online Weighted Average Linear Regression in Multivariate Data Streams
by: Abu-Shaira, Mohammad, et al.
Published: (2025)

OLC-WA: Drift Aware Tuning-Free Online Classification with Weighted Average
by: Shaira, Mohammad Abu, et al.
Published: (2025)

Merging Smarter, Generalizing Better: Enhancing Model Merging on OOD Data
by: Zhang, Bingjie, et al.
Published: (2025)

Decom-Renorm-Merge: Model Merging on the Right Space Improves Multitasking
by: Chaichana, Yuatyong, et al.
Published: (2025)

Model Merging: Foundations and Algorithms
by: Crisostomi, Donato
Published: (2026)

Model Merging in the Essential Subspace
by: Li, Longhua, et al.
Published: (2026)

CAT Merging: A Training-Free Approach for Resolving Conflicts in Model Merging
by: Sun, Wenju, et al.
Published: (2025)

MergeMix: Optimizing Mid-Training Data Mixtures via Learnable Model Merging
by: Wang, Jiapeng, et al.
Published: (2026)

BD-Merging: Bias-Aware Dynamic Model Merging with Evidence-Guided Contrastive Learning
by: Xie, Yuhan, et al.
Published: (2026)