Cover Image

Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lee, Yeoreum, Jung, Jinwook, Baik, Sungyong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Domain-Aware Fine-Tuning: Enhancing Neural Network Adaptability
by: Ha, Seokhyeon, et al.
Published: (2023)

Spectrum-Aware Parameter Efficient Fine-Tuning for Diffusion Models
by: Zhang, Xinxi, et al.
Published: (2024)

CoAPT: Context Attribute words for Prompt Tuning
by: Lee, Gun, et al.
Published: (2024)

Deep Variational Bayesian Modeling of Haze Degradation Process
by: Im, Eun Woo, et al.
Published: (2024)

Saliency-Aware Model Merging
by: Park, Jungin, et al.
Published: (2026)

SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes
by: Yang, Yifan, et al.
Published: (2025)

EMR-Merging: Tuning-Free High-Performance Model Merging
by: Huang, Chenyu, et al.
Published: (2024)

Preserving Domain Generalization in Fine-Tuning via Joint Parameter Selection
by: Pan, Bin, et al.
Published: (2025)

Kernelized Sparse Fine-Tuning with Bi-level Parameter Competition for Vision Models
by: Shen, Shufan, et al.
Published: (2025)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
by: Sun, Guangyu, et al.
Published: (2022)

Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models: A Survey and Benchmark
by: Xin, Yi, et al.
Published: (2024)

ATM: Improving Model Merging by Alternating Tuning and Merging
by: Zhou, Luca, et al.
Published: (2024)

Advancing Compositional Awareness in CLIP with Efficient Fine-Tuning
by: Peleg, Amit, et al.
Published: (2025)

Fairness-Aware Fine-Tuning of Vision-Language Models for Medical Glaucoma Diagnosis
by: Gu, Zijian, et al.
Published: (2025)

Weight Weaving: Parameter Pooling for Data-Free Model Merging
by: Chaves, Levy, et al.
Published: (2025)

FRISM: Fine-Grained Reasoning Injection via Subspace-Level Model Merging for Vision-Language Models
by: Huang, Chenyu, et al.
Published: (2026)

Domain-Aware Fine-Tuning of Foundation Models
by: Kaplan, Ugur Ali, et al.
Published: (2024)

GD-FPS: Growth-Driven Feedforward Parameter Selection for Efficient Fine-Tuning
by: Yang, Kenneth, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning of DINOv2 for Large-Scale Font Classification
by: Chen, Daniel, et al.
Published: (2026)

Parameter Competition Balancing for Model Merging
by: Du, Guodong, et al.
Published: (2024)

SeeDiff: Off-the-Shelf Seeded Mask Generation from Diffusion Models
by: Park, Joon Hyun, et al.
Published: (2025)

From Parameter to Representation: A Closed-Form Approach for Controllable Model Merging
by: Wu, Jialin, et al.
Published: (2025)

When Is Rank-1 Enough? Geometry-Guided Initialization for Parameter-Efficient Fine-Tuning
by: Zhao, Haoran, et al.
Published: (2026)

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
by: Zhang, Mingyang, et al.
Published: (2023)

Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
by: Ly, Son Thai, et al.
Published: (2024)

EGLOCE: Training-Free Energy-Guided Latent Optimization for Concept Erasure
by: Ahn, Junyeong, et al.
Published: (2026)

Resolving Interference (RI): Disentangling Models for Improved Model Merging
by: Ramesh, Pratik, et al.
Published: (2026)

SAM-PTx: Text-Guided Fine-Tuning of SAM with Parameter-Efficient, Parallel-Text Adapters
by: Jalilian, Shayan, et al.
Published: (2025)

Contrast-Aware Calibration for Fine-Tuned CLIP: Leveraging Image-Text Alignment
by: Lv, Song-Lin, et al.
Published: (2025)

Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidance
by: Nam, Giung, et al.
Published: (2024)

Diversity-Aware Agnostic Ensemble of Sharpness Minimizers
by: Bui, Anh, et al.
Published: (2024)

Bilateral Sharpness-Aware Minimization for Flatter Minima
by: Deng, Jiaxin, et al.
Published: (2024)

MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields
by: Chung, Jaeyoung, et al.
Published: (2022)

Vision-Language Model Fine-Tuning via Simple Parameter-Efficient Modification
by: Li, Ming, et al.
Published: (2024)

GRPO-RM: Fine-Tuning Representation Models via GRPO-Driven Reinforcement Learning
by: Xu, Yanchen, et al.
Published: (2025)

Learning Semantic Proxies from Visual Prompts for Parameter-Efficient Fine-Tuning in Deep Metric Learning
by: Ren, Li, et al.
Published: (2024)

STaTS: Structure-Aware Temporal Sequence Summarization via Statistical Window Merging
by: Bhowmick, Disharee, et al.
Published: (2025)

Task-Specific Directions: Definition, Exploration, and Utilization in Parameter Efficient Fine-Tuning
by: Si, Chongjie, et al.
Published: (2024)

AutoFT: Learning an Objective for Robust Fine-Tuning
by: Choi, Caroline, et al.
Published: (2024)

Directly Fine-Tuning Diffusion Models on Differentiable Rewards
by: Clark, Kevin, et al.
Published: (2023)