Cover Image

Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gauthier-Caron, Thomas, Siriwardhana, Shamane, Stein, Elliot, Ehghaghi, Malikeh, Goddard, Charles, McQuade, Mark, Solawetz, Jacob, Labonne, Maxime
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Arcee's MergeKit: A Toolkit for Merging Large Language Models
by: Goddard, Charles, et al.
Published: (2024)

Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluation
by: Siriwardhana, Shamane, et al.
Published: (2024)

Menopause transitions and the workplace theorizing transitions, responsibilities and interventions Edited by VanessaBeck and JoBrewis. Bristol University Press, Jan 10, 2024, 186 pp., ISBN: 978–1529215700, Price GBP 79.99, h/b
by: Laura McQuade
Published: (2024)

Novel regulators of nucleic acid sensing drive neurotoxic interferon response in microglia
by: Amanda McQuade
Published: (2025)

Factors affecting secondary teacher wellbeing in England: Self‐perceptions, policy and politics
by: Laura McQuade
Published: (2024)

Zero-Shot Multi-Lingual Speaker Verification in Clinical Trials
by: Akram, Ali, et al.
Published: (2024)

Jointly Fine-Tuning "BERT-like" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
by: Siriwardhana, Shamane, et al.
Published: (2020)

Fine-tune the Entire RAG Architecture (including DPR retriever) for Question-Answering
by: Siriwardhana, Shamane, et al.
Published: (2021)

DAM: Dynamic Adapter Merging for Continual Video QA Learning
by: Cheng, Feng, et al.
Published: (2024)

RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration
by: Yu, Hong Qing, et al.
Published: (2025)

Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering
by: Siriwardhana, Shamane, et al.
Published: (2022)

Revisiting Weight Averaging for Model Merging
by: Choi, Jiho, et al.
Published: (2024)

TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior
by: Altıntaş, Gül Sena, et al.
Published: (2025)

AdaMerging: Adaptive Model Merging for Multi-Task Learning
by: Yang, Enneng, et al.
Published: (2023)

Dispelling the magic of artificial intelligence in medical education
by: Casey N. McQuade, et al.
Published: (2024)

Differentially Private Model Merging
by: Yin, Qichuan, et al.
Published: (2026)

DeepMerge: Deep-Learning-Based Region-Merging for Image Segmentation
by: Lv, Xianwei, et al.
Published: (2023)

ACE-Merging: Data-Free Model Merging with Adaptive Covariance Estimation
by: Xu, Bo, et al.
Published: (2026)

Generalizing the Geometry of Model Merging Through Frechet Averages
by: da Silva, Marvin F., et al.
Published: (2026)

MIN-Merging: Merge the Important Neurons for Model Merging
by: Liang, Yunfei
Published: (2025)

Relation Extraction Across Entire Books to Reconstruct Community Networks: The AffilKG Datasets
by: Cai, Erica, et al.
Published: (2025)

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
by: Morrison, Jacob, et al.
Published: (2024)

Merge Tree Geodesics and Barycenters with Path Mappings
by: Wetzels, Florian, et al.
Published: (2023)

FW-Merging: Scaling Model Merging with Frank-Wolfe Optimization
by: Chen, Hao Mark, et al.
Published: (2025)

ASD-RSD; To Merge or Not to Merge
by: Sinclair, Dorothy
Published: (1971)

Survival Disparities among Alzheimer’s Patients in Hawaii: Exploring Racial/Ethnic Disparities and Machine Learning for Survival Prediction in the Hawaii Medicare Population
by: Chathura Siriwardhana
Published: (2024)

Towards Computing Average Merge Tree Based on the Interleaving Distance
by: Touli, Elena Farahbakhsh, et al.
Published: (2026)

Parameter-Efficient Checkpoint Merging via Metrics-Weighted Averaging
by: Yu, Shi Jie, et al.
Published: (2025)

Fine, I'll Merge It Myself: A Multi-Fidelity Framework for Automated Model Merging
by: Su, Guinan, et al.
Published: (2025)

To Merge and Not to Merge: Israel's Union List of Monographs in the Context of Merging Algorithms.
by: Lazinger, Susan S.
Published: (1994)

Soft Merging of Experts with Adaptive Routing
by: Muqeeth, Mohammed, et al.
Published: (2023)

Merging and Splitting Diffusion Paths for Semantically Coherent Panoramas
by: Quattrini, Fabio, et al.
Published: (2024)

Shattering the Shield: Embracing Complexity in Undergraduate Medical Education
by: Cara Bezzina, et al.
Published: (2025)

The Development of Professional Standards in Forensic Anthropology
by: Eric J. Bartelink, et al.
Published: (2025)

MergeRepair: An Exploratory Study on Merging Task-Specific Adapters in Code LLMs for Automated Program Repair
by: Dehghan, Meghdad, et al.
Published: (2024)

Asymmetric uncertainty : Nowcasting using skewness in real-time data
by: Labonne, Paul
Published: (2020)

Extrapolation Merging: Keep Improving With Extrapolation and Merging
by: Lin, Yiguan, et al.
Published: (2025)

Channel Merging: Preserving Specialization for Merged Experts
by: Zhang, Mingyang, et al.
Published: (2024)

Merged Reference Desks in a Merged Library Environment: The Impact of Merging Government Publications
by: Kendall, Susan L., et al.
Published: (2006)

Model Tells You Where to Merge: Adaptive KV Cache Merging for LLMs on Long-Context Tasks
by: Wang, Zheng, et al.
Published: (2024)